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ABSTRACT 


A  COMPARISON  OF  THREE  A1RCRAF1'  ATl'lTUDE  DISPLAY 
SYMBOLOGY  STRUCTURp:S 


In  modern  tactical  aircraft,  prlmaty  flight  attitucie  information  appears  In  two 
basic  display  configurations:  the  head-down  attlludc/dlrecllon  Indicator  (ADI)  and  the 
head-up  display  (HUD)  portrayal  of  attitude  Information.  Both  formats  contain  the 
same  Infonnatlon  and  both  are  present  In  the  cockpit.  Previous  studies  have  suggested 
that  separate  utilization  of  ADI  or  HUD  symbology  In  specific  situations  may  result  In 
task  dependent  performance  differences.  Differences  In  attitude  display  Information 
structure  exist  such  that.  In  order  to  optimize  performance,  the  pilot  must  decide  to  view 
the  correct  display  for  the  appropriate  situation.  Given  the  speed  and  maneuverability 
of  modern  tactical  aircraft,  visual  switching  between  displays  may  be  unacceptably 
dangerous  at  times. 

The  present  study  evaluated  the  conveyance  of  attitude  Infonnatlon  by  a  new 
aircraft  attitude  display  concept.  The  new  symbology  fomiat,  or  global  head-up  attitude 
reference  display  (THETA),  was  developed  by’ integrating  the  fonn  of  the  conventional 
ADI  and  the  transparency  attributes  of  the  HUD  Into  a  single  display  format.  The 
present  research  addressed  whether  or  not  there  was  a  significant  performance 
advantage,  or  decrement,  Incurred  by  the  new  symbology.  THEI'A.  the  ADI.  and  the 
HUD  were  evaluated  during  an  attitude  maintenance  task  as  well  as  an  unusual  attitude 
recoveiy  task.  Subjects  were  trained  to  a  specific  criterion  of  attitude  maintenance  task 
performance  on  one  of  the  three  displays.  Subjects  then  participated  In  a  simulated 
attitude  recovery  task.  The  results  of  the  sttidy  suggest  that  performance  was  similar 
with  the  THETTA  and  ADI  formats  while  performance  and  training  time  was  better  with 
both  THETA  and  the  ADI  than  with  the  HUD  format.  The  findings  of  the  study  lend 
support  to  the  hypothesis  that  an  attitude  dtsplay  formed  of  the  Integration  of  ADI  and 
HUD  type  symbology  will  demonstrate  a  performance  benefit  over  a  p\irc  tlUD  format. 
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INTRODUCTION 


In  the  tactical  alrcran  environment,  accurate  spatial  orientation  knowledge  is 
paramount  to  the  pilot's  overall  situation  awareness  (Gutlman,  1986).  Spatial 
orientation  Information  is  In  part  obtained  from  aircraft  attitude  reference  Indicators 
(ARIs),  which  represent  and  display  the  relationship  between  an  aircraft  being  flown 
and  the  earth's  surface  over  which  it  Hies. 

In  modem  tactical  aircraft,  primary  attitude  Infonnation  appears  in  two  basic 
ARI  visual  display  configurations;  the  head-down  attitude/direction  Indicator  (ADI) 
and  the  head  up  display  (HUD)  portrayal  of  attitude  information.  The  ADI  is  located  In 
front  of  the  pilot  and  Is  embedded  In  the  instmrnent  panel,  thus  the  pilot  must  look 
"Into"  the  aircraft  to  read  (he  display.  The  transparent  HUD  Is  located  above  the 
Instrument  panel  and  oriented  centrally  In  the  pilot's  field-of-vlew  so  that  the  pilot 
may  took  through  the  display  and  see  the  outside  world.  Both  ARI  formats  contah\  the 
same  basic  Information  (aircraft  pitcli,  roll,  and  heading).  However,  due  to  different 
display  media  and  Intended  utility,  the  displays  convey  altitude  Informal  ion  via 
dlfferem  features  and  symbology  slnicturcs. 

Previous  studies  have  suggested  that  separate  utlll/allon  of  ADI  or  HUD 
sjmbology  in  specific  situations  may  result  in  dlstlncl,  task  de|)etulcnt,  pcrfortnance 
differences  (such  as  recovery  from  unusual  attitudes).  DllTerences  In  atlltude  display 
Infomiatlon  structure  exist  such  that.  In  order  tn  optimize  perfoiiiumce,  the  pilot  must 
decide  to  view  the  correct  display  for  the  appropriate  situation.  For  example,  some 
pilots  flying  HUD  equipped  aircraft  are  trained  lo  refer  to  their  ADI  in  sltuallons  where 
soatlal  orlcnlation  Is  In  doubt  (Summers.  1985).  Given  the  speed  and  maneuverablllly 
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of  modem  tactical  aircraft,  visual  switching  between  displays  may  be  unacceptably 
dangerous  at  times. 

The  present  study  evaluated  a  new  attitude  display  symbology  concept.  The  new 
symbology  Is  a  global  head-up  attitude  reference  display  which  was  named  THETA 
because  Its  form  is  similar  to  the  Greek  letter  of  the  same  name.  The  THETA  symbology 
was  developed  by  combining  features  of  the  ADI  and  HUD.  The  Integration  involved 
combining  the  "best"  features  of  the  ADI  and  HUD  formats  by  fusing  the  Information 
structure  differences  onto  a  single  display.  In  affect,  this  presents  the  different  display 
features  In  such  close  proximity  that  the  Information  structure  difference  existing 
between  the  current  two  displays  may  no  longer  exist  in  the  THETA  symbology.  This 
study  addressed  whether  or  not  there  was  a  significant  performance  advantage,  or 
decrement,  incurred  by  the  symbology  Integration.  THETA,  as  It  appeared  in  this  study, 
was  not  Intended  to  represent  the  symbology's  final  configuration.  Instead,  the  intent 
was  to  demonstrate  the  performance  costs  and/or  benefits  associated  with  the 
integration  of  the  two  conventional  Inlommtion  structures  Into  one  new  symbology. 

BACKGROUND 

To  provide  the  appropriate  background  to  the  present  study,  this  section 
presents  a  brief  description  of  ADI  and  HUD  symbology  and  a  review  of  previous 
altitude  reference  Indicator  evaluation  research.  Tlie  ADI  and  HUD  are  then  discussed 
In  terms  of  their  display  features  and  principles  as  well  as  the  theoretical  basis  on 
which  the  THEI'A  symbology  was  developed.  Display  features  and  principles  incluflc: 
pictorial  realism,  display  objeclness,  and  display  compression.  'Pheoretlcal  lss\ies 
Include:  object  attention  and  global  perception  (associated  with  display  objeclness). 
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The  THETA  sjTnbology  is  then  described  relative  to  the  above  features,  principles  and 
Issues. 


DlaBifly,.S.\mbQlQgy 

The  following  paragraphs  describe  the  basic  formats  in  which  head-down  and 
head-up  attitude  reference  Indicators  presently  appear.  It  Is  Important  that  the  reader 
be  somewhat  familiar  with  the  display  symbologies  so  that  different  display  attributes 
can  be  kept  In  mind  throughout  the  review. 

ADI.  The  current  ADI  (Figure  1)  is  a  modification  of  Die  original  Sperry 

I 

I 

artificial  horizon  developed  In  1929  (Johnson  and  Roscoe,  1972).  This 
electromechanical  gyroscopic  display  Is  located  in  the  instrument  panel  of  modern 
tactical  aircraft.  The  ADI  is  a  three-dimensional  opaque  physical  ball  with  symbology 
printed  on  the  ball's  surface.  The  ilDI  was  developed  to  provide  roll,  pitch  and 
directional  Information  for  pilot  spatial  orientation  maintenance  during  Instrument 
referenced  flight  throughout  the  atrcreift  maneuvering  envelope. 

The  upper  and  lower  hemispheres  of  the  ADI  are  differentially  shaded  so  that 
the  contrast  between  the  light  (sky)  upper-half  and  the  dark  (ground)  lower-half  defines 
an  emtlflclal  liortzon.  In  order  to  determine  aircraft  altitude,  the  pitch  scale  bars  and 
longitudinal  he.adlng  line  position  are  compared  to  a  fixed  ownship  symbol 
superimposed  on  the  surface  of  the  ball.  The  ADI  Is  free  to  rotate  about  all  three  of  Its 
axes  and  Is  designed  to  represent  translation  relative  to  the  aircraft  as  if  the  aircraft 
was  statloneiry.  This  relationship  fomis  a  pure  Inside -out  earth  referenced  display 
coordinate  system  (Johnson  and  Roscoe.  1972).  The  ADI  also  Incorporates  a  bank  st;ale 
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Computer  Simulation  of  Conventional  Attitude/Direction  Indicator 


and  ground-pointer  along  the  bottom  of  the  display.  The  bank  scale  or  roll  Indicator 
gives  precise  roll  Information  at  bank  angles  equal  to  or  less  than  90  degrees. 

HUD.  For  the  HUD,  symbology  (Figure  2)  Is  projected  onto  a  transparent 
combiner  glass  In  a  collimated  fashion  so  that  the  Information  represented  is 
superimposed  on  the  outside  world.  The  Intent  of  this  approach  Is  to  form  an 
integration  of  focal  and  ambient  information  so  the  pilot  may  monitor  available  flight 
status  Information  (In  this  case  spatial  orientation)  without  losing  visual  contact  with 
the  outside  world.  This  Is  known  as  keeping  the  pilot's  head  out-the-window  (OTW), 

HUD  symbology  Is  focused  at  visual  infinity  so,  In  theory,  the  pilot  can  look  through 
the  transparent  display  and  view  the  distant  world  without  a  corresponding  change  In 
optical  accommodation.  It  Is  Important  that  the  HUD  be  as  uncluttered  as  possible  so 
that  the  OTW  scene  Is  not  excessively  occluded. 

The  attitude  information  structure  of  the  HUD  can  be  described  In  terms  of  Its 
components.  The  three  basic  components  are:  (1)  the  main  attitude  reference 
component  (referred  to  as  the  pitch-ladder),  (2)  a  heading  Indicator,  and  (3)  a  roll 
Indicator  with  an  associated  ground-pointer.  The  attitude  component  Is  formed  of  an 
artificial  horizon  which  cages,  pitch-bars  with  alphanumeric  designators  and  a  flight 
path  marker.  For  this  HUD,  the  ownship  symbol  was  fixed  with  respect  to  the  cockpit 
while  the  horizon  and  pitch-bars  move  about  It.  Like  the  ADI,  this  formed  an  InsIde-out 
oriented  display  (Johnson  and  Roscoe,  1972).  The  pitch-bar  lines  were  solid  above  the 
horizon  and  segmented  below.  In  addition,  the  pitch-bar  lines  were  articulated:  bent 
like  chevrons  pointing  In  the  direction  of  the  true  horizon:  giving  the  pilot  a  directional 
cue  to  follow  when  recovering  from  an  extreme  attitude  back  to  horizon-level  (Relsliig, 
1988).  The  attitude  "ladder"  moved  In  both  pitch  and  roll.  Heading  Information  was 
read  olT  a  tape  along  the  top  of  the  display.  Whatever  digital  value  appears  above  the 


5 


Figure  2.  Modified  Pitch  Ladder  HUD  Portrayal  of  Altitude  Information. 
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ownshtp  symbol’s  schematic  tall  was  the  aircraft's  heading.  The  roll  indicator  along 
the  bottom  of  the  display  gave  precise  roll  deviation  when  the  ground-pointer  symbol 
was  compared  to  the  bank  angle  scale  (only  at  less  then  45  degrees  roll). 

Previous  Research 

It  has  already  been  predicted  that  the  ADI  will  out  perform  the  standard  HUD 
symbology  In  conveyance  of  spatial  orientation,  (Roscoe.  Corl,  and  Jensen,  1981). 

Some  recent  studies  have  suggested  that  this  prediction  Is  in  fact  accurate. 

Kinsley,  Warner,  and  Glelsner  (1985)  conducted  two  experiments  to  assess  the 
relative  merits  of  the  current  F/A-18  pitch-ladder  ARI,  a  revised  pitch-ladder  HUD 
format,  and  a  conventional  ADI  for  recovery  from  unusual  attitudes.  The  revised  HUD 
was  developed  to  enhance  the  global  processing  properties  of  the  multl-dlmcnslonal 
HUD  symbology  by  adding  redundant  orientation  cues.  The  ADI  was  Included  In  the 
Investigation  as  a  result  of  discussions  with  Naval  Air  Test  Center  pilots  who  Indicated 
their  preference  for  the  ADI  as  an  attitude  indicator.  Kinsley.  Warner,  and  Glelsner's 
(1985)  first  experiment  compared  static  presentations  of  the  three  displays  to  determine 
the  ability  of  the  formats  to  aid  the  subject  in  deciding  how  to  recover  from  unusual 
attitudes.  Three  pitch  values  (0,  +55  and  -55  degrees)  were  crossed  with  six  roll  values  (0. 
60,  120,  180,  -120  and  -60  degrees)  to  form  the  stimuli  set.  Twelve  non-pilot  subjects 
viewed  the  stimuli  as  static  events  projected  onto  a  screen  and  were  asked  to  make  a 
determination  as  to  the  proper  recovery  action  by  making  a  control  stick  input.  The 
metrics  utilized  were  decision  time  (defined  as  the  duration  of  time  before  a  control 
Input  was  Initiated)  and  control  error  (control  reversals). 
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They  reported  that  the  ADI  resulted  In  significantly  faster  decision  times  than 
either  the  conventional  or  enhanced  HUD  formal.  No  error  differences  for  the  static 
presentation  reached  statistical  significance. 

Experiment  2  of  the  Kinsley  et  al.  (1985)  study  assessed  dynamic  ADI  and  current 
F/A- 18  HUD  pitch-ladder  ARI  formats.  Pitch  and  roll  values  were  Identical  lo  those 
used  In  the  first  experiment.  After  flying  straight  and  level  for  a  period  of  lime,  subjects 
were  forced  to  look  away  Ironi  the  ARI  lo  make  a  data  Input.  Upon  completion  of  the 
data  Input  task,  the  display  was  reoriented  so  that  It  represented  one  of  the  unusual 
attitude  conditions.  The  subject's  task  was  to  recover  the  aircraft  back  to  straight  and 
level  flight  as  quickly  as  possible.  Decision  and  recovery  times  were  recorded. 

Analysis  of  the  data  Indicated  that  the  display  condition  main  effect  for 
decision  time  failed  to  reach  statistical  significance.  On  the  other  hand,  the  recovery 
lime  metric  revealed  display  condition  performance  dllTerences  in  which  mean  time 
for  recovery  was  significantly  shorter  fur  the  ADI  than  the  HUD  pitch-ladder  (the 
revised  HUD  format  was  not  tested).  Kinsley  el  al.  (1985)  recommended  that  an 
optimally  located  eieclromeclianlcal  ADI  be  Included  within  I  he  fighter's  display  suite 
as  the  prlmaiy  or  secondary  spatial  orientation  Instnunent. 

A  study  closely  related  to  Kinsley  et  al.  (1985)  was  completed  by  Guttman  ( 1 986) 
to  see  If  the  addition  of  a  computer  generated  two-dimensional  ADI  located  directly 
below  the  existing  F/A- 18  HUD  would  aid  pilots  In  recovery  from  unusual  attitudes. 

Ttie  study  compared  three  display  fonnals  including  a  graphic  representation  of  an 
ADI,  an  F/A-18  HUD,  and  the  concurrent  use  of  the  ADI  and  HUD.  It  was  hypothesized 
that  the  concurrent  use  of  the  HUD  and  ADI  would  result  in  faster  decision  and  recovery 
limes  than  Die  use  of  ttie  HUD  alone.  It  was  also  believed  that  the  ADI  would 
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demonstrate  better  performance  than  the  HUD  In  the  single  display  conditions. 
Guttmeui  used  10  naval  aviators  with  and  without  previous  HUD  experience  as  subjects. 
The  experimental  procedure  was  Identical  to  the  dynamic  display  presentation 
experiment  performed  previously  by  Kinsley  et  al.  (1985).  Recorded  dependent 
variables  were  decision  and  recovery  time.  Also,  at  the  end  of  trial  data  collection, 
subjects  participated  In  a  structured  Interview  in  which  the  pilots  were  asked  to 
Indicate  the  display  format  they  preferred  overall  and  why. 

Recovery  times  were  faster  using  the  ADI  compared  to  the  HUD.  There  was  a 
significant  format  effect  in  which,  at  the  55  and  -65  degree  pitch  conditions,  the  ADI 
resulted  In  the  fastest  recovery  times.  The  concurrent  use  of  the  HUD  and  ADI  was  next 
fastest,  while  the  HUD  demonstrated  the  worst  recovery  performance.  During  the  post 
experiment  Interviews,  a  majority  (60%)  of  the  subjects  stated  that  they  most  preferred 
the  concurrent  use  of  the  ADI  and  HUD  because  the  displays  each  contained  features 
that  were  helpful  during  different  stages  of  attitude  recovery.  The  remaining  subjects 
(40%)  preferred  the  use  of  the  ADI  alone.  When  asked  which  display  was  least  preferred, 
70  percent  Indicated  the  HUD  format  while  none  of  the  subjects  least  preferred  the 
ADI/HUD  combination.  Guttrnan  (1986)  speculated  that,  during  recoverj'  from  extreme 
pitch  attitudes,  the  strengths  of  each  format  acted  to  compensate  for  the  weaknesses  of 
the  other.  He  then  qualified  the  statement  with  the  comments  of  several  of  the  naval 
aviators  and  the  fact  that  the  ADI  alone  showed  the  best  objective  perfommnce. 
However,  the  pilots  pointed  out  that  the  ADI  display  did  not  contain  airspeed  and 
altitude  Information  that  would  be  necessary  for  actual  extreme  allltude  recovery. 

Osgood  and  Veriturlno  (1990)  Investigated  the  effects  of  various  attitude  displays 
and  their  associated  visual  features  on  performance  of  a  siinulaled  unusual  attitude 
recovery  task  on  a  wide  fleld-of-vlew  helmet-mounted  display.  A  simulated  ADI,  a 
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modified  insldc-out  HUD,  an  outstde-ln  HUD,  and  an  egocentric  HUD  were  among  the 
evaluated  attitude  display  formats.  There  were  four  roll  groups  up  to  lt50  degrees  and 
three  pitch  angle  groups  up  to  45  degrees.  Six  dependent  variables  were  recorded:  time  to 
first  control  Input  in  roll  and  pitch,  input  accuracy  in  roll  and  pitch,  and  the  number  of 
control  reversals  in  the  first  second  of  lnput"ln  roll  and  pitch. 

Among  the  findings  for  the  displays,  the  data  suggested  that  error  and  Initial 
control  reversals  with  the  ADI  format  were  consistently  fewer  or  no  different  than  that 
of  the  Inslde-out  HUD.  Performance  for  the  ADI  was  equal  to  or  better  than  that  of  the 
HUD,  but  at  no  time  was  performance  via  the  HUD  better  than  the  ADI. 

The  studies  demonstrate  a  clear  performance  advantage  for  the  ADI  display 
format  In  an  experimental  setting.  Possible  reasons  for  the  performance  differences 
may  be  explained  in  terms  of  the  display  features. 

Pictorial  realism.  Researchers  have  theorized  that,  for  a  spatial  orientation 
representation,  the  display  feature  of  pictorial  realism  Is  Important  (Burns  and 
Lovering.  1988;  Prevlc,  1989:  Roscoe,  Corl,  and  Jensen,  1981;  Taylor.  1982,  1984,  1988). 
Roscoe.  Corl  and  Jensen  (1981)  explain  that  pictorial  realism  for  orientation 
representation  presents  a  spatial  analog  of  the  real  world  In  which  the  position  of  an 
object  Is  convincingly  seen  In  depth  os  well  as  up-down  and  left-right  (Roscoe,  1968). 
They  Iheorl/.ed  that  plctorlally  realistic  displays  penult  the  pilot  to  use  highly  learned 
perceptual  rules  about  the  world  to  reduce  ttic  amount  of  Infonnntlon  that  must  be 
processed  before  making  control  responses.  Roscoe,  Corl,  and  Jensen  (1981)  write;  "No 
such  direct  comparison  (between  the  display  and  the  earth)  can  be  made  If  the 
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Information  Is  presented  on  single-parameter  symbolic  displays."  This  statement 
suggests  that  some  amount  of  pictorial  realism  seems  necessary  in  order  to  cue  the 
observer's  natural  orientation. 

The  present  head-down  ADI  (Figure  1)  contains  pictorial  realism.  The  ADI 
presents  attitude  information  as  a  contact-analog  of  the  real  world  such  that  the 
display  behaves  In  a  manner  that  is  analogous  to  viewing  a  pictorial  representation  of 
the  world  through  a  port  tiole  at  the  front  of  (he  aircraft  (Roscoe.  1968).  Comparing  the 
position  of  the  o'a  nr.nip  symbol  to  the  display's  artificial  horizon  gives  general  aircraft 
roll,  pitch  and  heading  (when  scaled)  Information  (the  ball  rotates  about  Its  vertical 
axis  as  heading  changes  occur),  Roll,  pitch,  and  heading  scales  afford  precise  status 
reference  as  well  as  motion  trend  cues.  The  contrast  between  the  display  hemispheres 
(light  on  top  and  dark  on  the  bottom)  simulates  the  contrast  between  the  sky  and  the 
earth  when  viewing  the  actual  out-the-wlndow  scene.  This  contrast  also  acts  as  an 
Inversion  cue, 

For  superimposed  displays  such  as  the  HUD,  there  is  an  obvious  need  to 
minimize  obscuiation  of  the  outside  world.  Apparently  It  is  for  this  reason  that  HUDs 
(Figure  2)  display  abstract,  symbolic  codes  ihat  rely  on  lines,  shapes  and  numerals  for 
roll,  pitch  and  heading  information  (Taylor,  1984,  1988).  Taylor  (1982)  concluded  that 
none  of  the  HUD  symbology  features  he  tested  (segmented  pitch-bars,  pitch-bar  tags, 
etc.)  appeared  to  have  a  natural  orientation  nor  provided  inherently  meaningful  cues  to 
aircraft  orientation.  The  HUD  symbology  struclure  results  in  a  display  that  Is  divisible 
into  separate  Infonnatton  components  (separable)  such  as  heading  Information  which 
Is  not  Included  on  the  pitch-ladder. 
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For  the  ADI,  pictorial  realism  results  in  a  display  that  Is  a  unitary  whole  formed 
of  Integrated  continuous  information  similar  to  that  Information  found  In  the  real 
world.  However,  the  symbolic  HUD  Is  formed  of  separable  redundant  discrete 
Information.  The  following  sections  discuss  the  processing  consequence  of  the 
Infonnatlon  structure  differences  existing  between  these  displays. 

Display  objectneas.  Display  objectness  refers  to  the  representation  of  one  or 
several  information  variables  as  dimensions  of  a  single  object  (Wickens,  1986),  For 
example,  in  the  ADI,  the  dimensions  of  the  object  represent  variables  of  aircraft 
movement.  As  the  aircraft  changes  in  pitch,  the  ADI  tilts,  as  a  roll  change  occurs,  the 
ADI  rolls,  and  as  heading  changes,  the  ADI  spins. 

According  to  Wickens  (1986),  the  most  critical  defining  attribute  of  display 
objectness  is  the  presence  of  contours  (real  or  subjective),  and  an  object  Is  that  which  is 
defined  by  closed  contours.  Because  the  ADI  is  enclosed  within  a  contour,  and  simulates 
a  three  dimensional  object,  the  display  maintains  the  feature  of  objectness.  The 
objectness  of  the  symbolic  HUD  may  not  be  as  Intuitive  as  the  ADI.  Also,  the  contours 
of  the  ADI  may  encompass  more  meaning  than  those  of  the  HUD.  Tlie  line  and 
alphanumeric  symbology  on  the  ADI  Is  Included  within  the  overall  contour  of  the  ball 
while  the  lines  of  the  HUD,  by  definition,  form  Independent  objects. 

Using  the  taxonomy  of  object  display  research,  an  object  Is  more  Integral  than 
Us  symbolic  counterpart.  The  contours  of  the  object  are  joined  so  that  their  combined 
features  create  a  new  or  "emergent  feature"  (Wickens,  1986).  The  lines  and  dllTerentlally 
shaded  hemispheres  of  the  ADI  are  Joined  to  form  the  overall  contour  of  a  "ball"  so  that 
the  newly  formed  angles  and  contrast  are  perceived  as  roll,  tilt,  and  spin.  But  for  the 
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HUD.  the  lines  are  more  separable,  less  easily  seen  as  integral,  and  seemingly  do  not 
form  an  emergent  feature. 

The  objectness  of  the  ADI  may  allow  it  to  be  processed  as  a  single  unitary  object, 
while  the  HUD.  formed  of  many  objects  within  close  proximity,  may  require  more  lime 
consuming  and  complicated  processing.  Theoretically,  this  Is  analogous  to  processing 
a  plctogram  compared  to  mentally  integrating  actual  text.  Wlckens  and  Andre  (1990) 
point  out  that  performance  differences  depend,  to  a  great  extent,  on  tlie  Information 
Integration  requirement  associated  with  a  specific  task. 

Ohject  attention.  Object  attention  refers  lo  the  manner  In  which  humans 
distinguish  objects  and  object  features  from  their  background,  other  objects,  and  other 
features  (Prevlc,  1989).  Object  attention  research  has  suggested  that  symbology 
structures  formed  of  non-separable  (integrated)  features,  such  as  the  ADI,  may  be 
discriminated  with  less  use  of  focal  attention  and  processing  effort  (Trelsman  and 
Gelade,  1980),  For  attitude  display  design,  the  potential  dlfl'erence  In  attention 
requirements  for  unltaiy  integral  displays  (objects)  versus  separable  Information  (HUD 
symbology)  may  be  critical,  as  may  the  relative  benefit  of  global  perception. 

Redundancy  is  often  added  to  ssmibollc  attitude  displays  under  the  logic  that 
presenting  similar  Information  In  more  and  dllTerent  ways  should  aid  the  Infommtlon 
conveyance  efficiency  of  the  display  in  the  form  of  a  redundancy  gain  (Taylor,  1984). 

An  example  of  redundancy  In  the  HUD  is  the  Indication  of  the  area  below  the  horizon 
(negative  pitch);  (1)  pitch-bar  lines  are  segmented,  (2)  the  alphanumerlcs  have  negative 
signs  and.  (3)  the  chevrons  point  up  ns  do  the  pitch-bar  lags-when  not  inverted.  On  the 
HUD,  addition  of  information  in  the  form  of  redundancy  is  tiot  Integrated  into  an 
existing  display  object.  Redundancy  creates  conjunctions  of  separable  features  which 
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may  in  actuality  work  against  the  display  by  pulling  upon  unnecessary  focal  aitentlon 
as  well  as  Information  processing  time  required  for  feature  integration.  According  to 
Prevlc  (1989)  the  optimal  attitude  display  should  be  processed  as  a  unitary  percept, 

Trelsman  and  Qelade  (1980)  tested  the  feature-integration  theory  of  attention 
which  holds  that  attention  must  be  directed  serially  to  each  stimulus  In  a  display 
whenever  conjunctions  of  more  then  one  separable  feature  are  needed  to  characterize  or 
distinguish  the  symbol  meaning.  Integral  features  arc  conjoined  automatically,  while 
separable  features  require  attention  for  their  integration.  Trelsman  and  Oelade's  ( 1980) 
hypothesis  Included;  for  visual  search  and  discrimination,  If  two  physical  properties 
are  Integral,  they  should  function  as  a  single  feature  (under  the  experimental  paradigm) 
allowing  parallel  search.  If  the  stimuli  are  separable,  their  conjunctions  will  require 
focused  attention.  Conjunctions  were  expected  to  require  serial  search  and  should  have 
no  effect  on  performance  unless  focally  attended. 

A  number  of  experiments  were  perfoimed  by  Trelsman  and  Gelade  (1980)  In 
order  to  Investigate  the  above  hypotheses.  The  experiments  utilized  the  visual  search 
paradigm  to  compare  color-shape  conjunctions  with  disjunctive  color  and  shape 
features  as  targets  and  dlstractors.  The  ex|)erlmental  results  suggested  that  search  was 
serial  when  separable  features  were  required  to  characterize  targets  and  parallel  when 
Integral  features  were  utilized. 

Taylor  (1984)  perfomied  several  studies  In  order  to  examine  the  elTccls  of 
various  HUD  symbology  features  Intended  to  produce  a  redundancy  gain  in  attitude 
recovery  performance.  The  experimental  findings  Indicated  that  a  redundancy  gain 
occurs  only  when  combinations  of  integral  stimuli  dimensions  were  formed.  Addition 
of  Integra)  stimuli  form  emergent  features  that  are  processed  ns  a  single  unified  whole. 
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Taylor  (1984)  hypothesized  that  the  presence  of  separate  non-integral  stimuli  (the 
addition  of  horizon-pointing  pitch  line  tags  and  asymmetric  numerals)  may  attract 
unnecessary  attention,  increase  response  latencies,  reduce  salicncy  and 
discriminability  of  the  most  effective  cues,  and  cause  clutter  and  obscuration  of  the 
outside  world.  Taylor  (1984)  uses  a  clever  speech  analogy:  Integral  structures  shout 
clearer  and  louder  and  separate  redundant  structures  merely  repeat  the  message, 
However,  Taylor’s  findings  for  HUD  symbology  can  not  be  directly  compared  to  the  ADI 
because,  to  date,  the  ADI  has  not  been  examined  at  the  renlure  level.  The  i)erforniancc 
gain  afforded  by  the  ADI  pitch-bars  and  longitudinal  lines  is  not  known, 

Global  form  perception.  Global  form  perception  (QFP)  refers  the  perception  of  a 
level  of  visual  structure  that  is  made  up  of  constituents  at  a  lower  or  "local"  level 
(HotTinan,  1980).  GFP  is  the  perception  of  a  whole  object  which  Is  made  up  of  one  or 
more  features.  The  Importance  of  global  form  perception  for  head-up  attitude  display 
designs  lies  with  its  ability  to  create  vivid  percepts  which  are  natural  and  minimally 
dependent  on  actual  contour  information  (Prevlc,  1989).  Incorporating  globally 
perceived  object  features  Into  attitude  display  symbology  design  could  result  in  reduced 
display  clutter  and  enhanced  "see-through"  visibility  while  allowing  interpretation 
under  degraded  visual  conditions. 

Navori  (1977)  explored  a  principle  of  global  precedence  which  suggests  that  the 
global  structuring  of  a  scene  precedes  analysis  of  local  features  in  human  visual 
perception.  Navon  (1977)  perfonned  a  number  of  experiments  reminiscent  of  the 
Stroop  (1936)  studies  in  order  to  investigate  the  questions;  Do  we  perceive  a  visual  scene 
feature-by-feature?  Or  is  the  process  instantaneous  and  simultaneous?  According  to 
Navon  (1977),  the  globality  of  a  visual  feature  corresponds  to  the  place  it  occupies  in  the 
scene  structure  hierarchy:  At  the  top  of  the  hierarchy  the  nodes  are  more  global  then 
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the  nodes  at  the  bottom  or  local  level.  It  Is  claimed  that  processing  of  a  scene  proceeds 
from  global-to-local  where,  as  If  focusing,  gross  fealures  are  processed  followed  by 
fine-grained  analysis.  For  display  design,  It  may  be  true  that  the  less  an  observer  has  to 
focus  on  the  Image  and  the  less  fine-gain  analysis  required,  the  less  processing  time  and 
effort  will  bo  required  for  information  extraction. 

Navon  (1977)  equated  the  properties  of  global  and  local  features  by  u.slng  stimuli 
In  which  possible  global  fealures  were  Identical  lo  lhat  of  the  sel  of  possible  local  ones. 
This  was  accomplished  by  using  large  letters  formed  of  smaller  letters.  Navon  ( 1977) 
collected  data  suggesting  that  the  global  pattern  of  the  letter  stimuli  was  responded  to 
faster  than  the  elements  of  which  it  was  formed.  Results  Indicated  that  people  can 
voluntarily  attend  to  the  global  pattern  without  being  affected  by  the  local  fealures  but, 
they  are  not  able  to  process  the  local  fealures  without  being  affected  by  the  whole.  A 
further  study,  utilizing  global  and  local  fealures  of  spatial  patterns,  found  that  global 
differences  are  more  frequently  delected  than  local  differences  and  that  the  global 
configuration  Is  more  likely  lo  be  perceived  on  brief  exposures  than  the  local  pattern. 
This  finding  suggests,  according  to  Navon  (1977),  that  local  analysis  must  occur  lalei  In 
the  process. 

Hoffman  (1980)  performed  two  experiments  designed  to  lnve.stlgute  questions 
similar  to  those  asked  by  Navon  (1977).  fJoes  the  human  perceptual  system  process  the 
existence  of  local  structures  and  a  subsequent  global  form  Is  predicted  (bottom-\ip 
processing),  or  Is  the  global  form  perceived  and  thus  Irjfers  the  exisletjce  ol  appropriate 
local  features  (top-down  processing)?  Hoffman  (1980)  found  that  global  level  of  form  Is 
not  Invariably  processed  prior  to  local  levels.  The  data  .suggested  that  the  quality  of 
local  and  global  features  n»ny  predict  the  direction  of  processing.  If  the  global  features 
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are  degraded,  the  probability  of  local  feature  processing  preceding  global  processing 
Increases. 

The  HUD  and  the  ADI  both  contain  fine  grain  local  features  but.  much  like  the 
objectness  of  the  displays,  the  ADI  appears  to  be  more  global.  This  can  be  easily 
demonstrated  by  degrading  the  focus  of  the  displays  and  determining  which  becomes 
useless  first.  The  "roundness"  and  sky /ground  contrast  of  the  ADI  Is  responsible  for 
this  phenomenon.  Under  degraded  conditions,  stich  as  vibration,  high  luminance 
levels,  and  high  rates  of  movement,  the  user  has  both  global  and  local  features 
available  within  the  ADI.  while  the  HUD  may  require  more  fine  grained  analysis.  This 
may  result  In  the  ADI  requiring  less  focused  attention  and  processing  effort.  The  ADI 
may  be  processed  more  "amblently"  than  the  HUD. 

An  example  of  a  HUD  global  feature  is  the  shape  relationship  formed  by  the 
asymmetric  pitch -bar  numerals,  as  well  as  pitch-bar  articulation.  Experimental 
evidence  has  suggested  that  features  within  the  HUD  which  are  thought  to  be  globally 
processed  result  In  better  performance  than  that  of  its  local  counterparts.  Taylor  (1984) 
found  that  global  conflgural  characteristics  were  superior  to  local  features  for 
Indicating  roll  orientation;  particularly,  as  mentioned  above,  for  the  use  of  asymmetric 
positioning  of  pitch-bar  numerals.  In  a  separate  pitch  task  experiment,  Taylor  (1984) 
found  that  sloped  pitch-bars  (pitch-bar  Inclination  did  not  vary  with  pitch  angle) 
produced  better  performance  than  pitch-bars  without  an  Inclination.  Zenyuh,  Relslng. 
and  McClain  (1987)  helped  to  confirm  the  articulated  (inclination  varying  with  pitch 
angle)  perfomiance  gain. 

Display  comuresslon,  Display  compression  is  the  relationship  between  a 
display  and  the  real  world  in  terms  of  rate  of  motion,  resolution,  and  field-of-vlew.  The 
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rate  of  motion  relationship  between  the  HUD  In  this  study  and  the  world  Is  1 : 1  in  both 
pitch  and  roll  axes,  This  relationship  translates  into  high  resolution  pitch 
information  at  the  cost  of  a  reduced  fleld-of-vlew  (FOV)  and  the  poterillal  for  high  rates 
of  motion  during  high  energy  aircraft  maneuvering.  According  to  Bums  and  Lovering 
(1988),  the  use  of  a  1: 1  display  such  as  the  HUD  enhances  precise  control  in  the  pitch 
axis  but  may  degrade  the  pilot's  ability  to  acquire  and  maintain  spatial  awareness  due 
to  the  reduced  FOV  and  high  rates  of  display  translation.  The  HUD  has  a  limited  FOV  In 
pitch,  as  well  as  heading,  although  the  HUD's  transparency  enables  out-the-wlndow 
contact  when  the  world  Is  not  obscured.  This  HUD  format  displays  a  maximum  of  1 5 
degrees  pitch  and  90  degrees  of  azimuth  area. 

The  ADI  Is  compressed  so  that  its  display/world  ratio  Is  greater  than  one.  The 
ADI  artificial  horizon  does  not  have  to  move  as  far  as  the  natural  horizon  to  represent 
the  same  deflection.  The  ADI  world-to-dlsplay  ratio  results  In  a  display  movement 
"slowing."  The  large  FOV  of  the  ADI  maintains  some  portion  of  the  horizon  In  view  at 
all  times.  Only  at  extreme  attitudes  such  as  +/-90  degrees  pitch  Is  there  not  some 
portion  of  both  the  upside  and  the  down  side  of  the  display  In  view  dt  iiing  changes. 

Bums  and  Lovering  (1988)  performed  a  study  comparing  three  different 
electronic  altltude/dlrectlon  Indicators  (EADls).  The  evaluation  tested  two  modified 
EADI  formats:  a  two-dimensional  EADl  with  the  addition  of  sky-polntlng  arrow 
graphics,  and  a  three-dimensional  EADI  with  sky-pointer  arrows,  and  a  conventional 
EADI  for  their  relative  merit  enhancing  attitude  awareness.  The  two-dimensional 
displays  had  a  60  deg  FOV  while  the  three-dimensional  EADI  had  a  180  deg  FOV. 
Military  pilot  subjects  performed  unusual  attitude  recoveries  via  each  of  the  three 
displays  at  24  different  pllch/roll  positions.  Subjects  were  Instructed  tlial  they  were 
not  racing  the  clock.  They  were  instnicted  to  consider  energy  management  and  'g' 
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loading.  The  collected  objective  data  included  decision  time,  recovery  time,  correct 
response,  altitude  gain  and  altitude  loss.  Subjective  data  were  also  collected  via  a 
verbal  debriefing,  Modified  Cooper-Harper,  and  written  questionnaire  completed  after 
each  experimental  session  and  at  the  end  of  the  evaluation. 

Analysis  of  the  abjective  data  Indicated  significantly  faster  decision  times  for 
the  conventional  EADl  and  modified  two-dimensional  EADl  than  the 
three-dlmenulonal  EADl.  This  dllferencc  was  present  only  In  the  nose  low  pitch 
position,  while  no  difference  was  detected  between  the  display  at  the  nose  high  or  nose 
level  positions.  For  recoveiy  time,  no  significant  differences  were  found  between  the 
displays.  Response  accuracy  for  the  three-dimensional  EADl  did  not  differ 
significantly  from  either  of  the  other  displays.  Altitude  gain  and  loss  data  failed  to 
reach  any  statistically  significant  differences. 

Bums  and  Lovering  (1988)  submitted  Modified  Cooper-Harper  (MCH)  rating  data 
to  an  analysis  of  variance  (ANOVA)  and  found  the  three-dimensional  EADl  to  be 
significantly  more  dc.3lrable  than  the  other  displays.  A  preference  for  the 
three-dimensional  display  continued  to  be  significant  when  the  data  were  separated  by 
attitude  condition  and  analyzed.  The  subjective  questionnaires  Indicated  that  a 
majority  of  the  subjects  preferred  the  three-dimensional  EADl  formal  for  recovery 
from  unusual  attitudes.  The  pilots  commented  on  tlie  large  FOV  EADl  format's  ability 
to  convey  attitude  Information  as  the  "big  picture"  both  Instantly  and  Intuitively. 

The  Incongruity  between  the  objective  and  subjective  data  Indicates  that  the 
large  FOV  EADl  may  Indeed  be  superior  to  the  other  displays  but  the  effect  was  not 
detected  experimentally  for  whatever  reason.  Overall,  the  pilots  felt  that  the  larger  FOV 
EADl  was  the  most  useful  display.  The  fact  that  the  pllois  reacted  more  favorably  to  the 
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large  FOV  EADI  may  have  significant  Impact  on  the  success  of  the  display  In  training  as 
well  as  overall  usability. 

THETA  Display 

The  THETA  display  was  developed  by  the  author  by  Integrating  the  symbology 
structures  of  the  standard  ADI  and  HUD  Into  a  single  display  format.  Tlic  THEI'A 
formal  (Figure  3)  Is  a  simulated  three-dimensional  transparent  "half-ball"  with  an 
enhanced  horizon  line  Eind  directional  alphanumeric  designators.  The  simulated  bull 
has  a  shaded  outer  surface  which  forms  the  outer  edge  of  the  display.  The  transparent 
Imaginary  Inner  surface  of  the  virtual  half-ball  is  formed  by  arched  line  symbology. 
The  vert-lcal  lines  that  give  the  ball  its  apparent  roundness  Indicate  azimuth  position 
In  30  degree  Increments.  The  THETA  symbology,  like  the  ADI,  is  free  to  rotate  In  all 
three  of  Its  axes.  Like  the  HUD,  upper  and  lower  hemispheres  of  the  display  are 
Indicated  by  continuous  and  segmented  longitudinal  line  symbology.  Aircraft  attitude 
la  read  from  the  THETA  display  by  comparing  a  HUD-llke  ownshlp  symbol  (with 
elongated  wings)  to  the  artificial  horizon,  pitch-bars,  and  longitudinal  heading  lines. 
The  following  sections  discuss  the  THETA  display  symbology  format  in  terms  of  the 
display  features  and  principles  on  which  It  Is  based. 

Pictorial  realism.  The  THETA  symbology  was  designed  to  mimic  the  pictorial 
realism  of  the  ADI.  The  THETA  symbology  represents  a  spatial  analog  of  the  real  world 
but.  because  of  Its  transparency,  it  can  not  include  a  sky/ground  r  mtrast  to  the  same 
extent  as  the  ADI.  For  the  THETA  format,  a  sky/ground  contrast 's  fonned  between 
continuous  and  segmented  longitudinal  azimuth  lines.  Due  to  the  Incomplete  contrast 
between  the  two  degrees  of  line  integrity.  It  was  necessary  lo  draw  an  artificial  horizon 
line.  It  Is  possible  .  hat  lack  of  sky /ground  contrast  In  the  THETA  format  may 
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Positive  pitch  area  and  pitch  lines 


Plight  path  symbol 


Figure  3.  New  Global  Attltude/DlrecUon  Indicator  Head-up  (THETA)  Symbology 
Format. 
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remove  some  of  the  natural  orientation  thoui;ht  to  be  inherent  In  the  ADI  (Taylor, 
1982). 


The  THETTA  format,  like  the  ADI.  is  free  to  move  about  all  three  of  its  axes.  Tlie 
ownship  symbol,  when  compared  to  the  THETA  artificial  horizon  and  azimuth  lines, 
represents  aircraft  roll,  pitch,  heading  status,  and  motion  trend  cues  as  a  miniature 
pictorial  representation  of  the  out-the-wlndow  scene  as  if  viewed  through  a  port  hole. 
Thus,  the  display  forms  a  contact -analog  of  the  real  world. 

Qbjectness.  The  THETA  format  represents  aircraft  attitude  variables  in  much 
the  same  way  as  the  ADI.  Aircraft  roll,  pitch,  and  azimuth  translation  is  integrated 
into  a  simulated  ball  which  represents  movement  via  a  corresponding  display  roll,  tilt, 
and/or  spin.  The  most  pronounced  difference  between  the  ADI  and  the  THETA 
symbology  is  that  the  ADI  simulates  an  opaque  solid  ball  while  the  THETFA  display 
simulates  a  transparent  "wire  frame"  half-ball.  Configuring  line  symbology  in  such  a 
way  that  Individual  contours  form  the  outline  of  various  segments  of  a  ball  rcsulis  in 
an  objectness  emergent  feature.  Because  only  the  minimally  necessary  contours  are 
used  to  fomi  the  objectness  of  the  structure,  the  display  continues  to  be  see-through. 

Like  the  ADI,  the  THETA  fomiat  Incorporates  strong  contours  which  encompass 
the  display  symbology.  A  strong  "edge"  contour  is  formed  by  the  visible  shaded  surface 
of  the  ball.  Tlie  objectness  of  the  symbology  may  allow  it  to  be  prot^essed  as  a  single 
unitary  object  affording  some  of  the  ADI  perfonnance  advantages.  The  THETA  design 
relies  on  ns  little  redundancy  as  jjosslble  and  separable  features  are  not  created,  'I'he 
format  does  not  utilize  a  sky  or  ground-pointer  and  n/lmulh  Information  is  Integrated 
into  the  display.  The  integral  features  of  the  display  fonn  a  global  percept  that  may 
require  little  actual  contour  information  for  interpretation. 
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Display  compression.  THETA  is  a  compressed  display  formal  that  may  benefit 
from  a  large  FOV  and  decreased  apparent  motion.  The  symbology  FOV  Includes  180 
degrees  of  azimuth  by  180  degrees  In  elevation.  Like  the  ADI,  THETA's  three 
dimensionality  may  be  effective  in  presenting  "big  picture"  spatial  awareness.  The 
enhanced  horizon  line  is  constantly  Iri  view  as  are  both  the  up  and  down  reference 
hemispheres  (with  the  exception  of  +/-90  degrees  pitch  positions). 


THE  PRESENT  STUDY 


The  present  study  Involved  the  evaluation  of  a  new  ARI  symbology  structure 
concept.  The  THETA  symbology  was  developed  by  Integrating  the  successful  altrlbtttes 
of  two  existing  display  formats  onto  a  single  new  display  format.  The  THETA  format 
maintains  characteristics  In  common  with  both  the  ADI  and  the  HUD  but  forms  a 
completely  new  format.  Because  the  ADI  and  HUD  have  consistently  demonstrated  task 
dependent  performance  differences,  such  as  significantly  fastest  recovery  performance 
via  ADMlke  formats.  It  was  hypothesized  that  the  THEFA  formal  would  result  in 
performance  consistent  with  that  of  the  symbology  features  of  the  conventional 
displays.  The  ADI  has  proven  to  be  successful  as  an  aid  to  attitude  awareness  and  the 
HUD  affords  awareness  while  the  pilot  maintains  out-the-wlndow  contact  with  the 
world.  The  THETTA  formal  should  afford  ADl-llke  attitude  awareness  while  being 
HUD-llke  transparent.  The  present  study  addressed  the  question  of  whether  there 
would  be  a  significant  perfonnance  increase  or  decrement  Incurred  by  the  'I’HETA 
symbology  structure  compared  to  the  simulated  conventional  ADI  and  HUD  ARI 
formats. 
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The  present  study  evaluated  the  TH12TA  symbology  by  comparing  the  new 
format  to  the  conventional  ARls  in  much  the  same  manner  as  the  ADI  and  HUD  have 
been  compared  to  one  another  in  the  past  (Kinsley,  Warner,  and  Glelsner,  1986: 
Outtman,  1986:  Bums  and  Lovering.  1988).  Subjects  performed  experimental  trials 
consisting  of  both  a  practice  attitude  maintenance  I  ask  and  an  attitude  recovery  task. 
Subjects  learned  their  specific  display  by  performing  an  attitude  maintenance  task. 

The  altitude  maintenance  task  required  that  the  subject  maintain  a  straight  and  level 
display  reprcsentallon  while  being  bulTeted  by  a  roll  and  pitch  dlsltirbance  funcllon, 
Subjects'  root  mean  squared  deflection  error  from  straight  and  level  comprised  the 
attitude  maintenance  perfomiance  data.  After  training  and  performing  to  criterion  on 
three  different  disturbance  function  amplitudes,  subjects  moved  onto  an  unusual 
altitude  recovery  task,  The  unusual  attitude  recovery  Experimental  Session  borrowed 
the  method  Incorporated  by  Kinsley,  Warner,  and  Glelsner  1985  and  Guttman,  1986. 
Subjects  were  required  to  recover  the  simulated  aircraft  display  representation  to  a 
status  of  straight  and  level  from  a  prcdetemilned  unusual  attitude.  Attitude  recovery 
performance  data  Included  recovery  accuracy,  decision  time,  and  total  recovery  time. 

It  was  hypothesized  that  performance  with  the  THETA  fonnat  on  the  attitude 
maintenance  and  recovery  tasks  would  be  at  the  same  level  If  not  belter  than  the 
conventional  ADI  ball  and  performance  for  both  THETA  and  the  ADI  would  be  superior 
to  that  of  the  HUD  pitch  ladder  format. 
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METHOD 


SuUteclfl 

Subjects  were  drawn  from  a  Loglcon  Technical  Services  Incorporated  mana({ed 
subject  pool  at  Wrlftht-Patterson  AFB,  OH.  Subjects  (N«45)  were  paid  five  dollars  per 
hour  for  their  participation.  Out  of  the  total  of  45  subjects  that  attempted  the  Initial 
Tralnlnjj  Session,  15  subjects  failed  to  reach  performance  criterion  (one  under  the  ADI 
format  and  14  under  the  HUD  format)  and  thus  were  not  eligible  to  return  for  the 
Experimental  Session.  Of  the  14  HUD  subjects  who  failed  to  meet  perfonnance 
criterion,  nine  were  returned  to  the  laboratory  in  order  to  rerun  a  Training  Session 
with  a  different  display  from  the  one  with  which  they  originally  participated. 
Experienced  pilots  and  subjects  with  flight  simulation  experience  were  not  permitted  to 
take  part  In  the  study.  Subjects  were  male,  right-hand-dominant  (self-reported),  college 
students  between  the  ages  of  18  and  30  with  nomial  or  corrected  to  normal  vision 
(20/20).  Subjects  were  given  complete  Information  concerning  their  participation  and 
were  free  to  withdraw  from  the  study  at  any  time.  No  deception  was  employed  and 
subjects  were  thoroughly  debriefed. 

Design 


Three  Independent  groups  each  participated  under  a  dlfl'erent  display  formal 
condition.  After  a  five  minute  familiarization  session,  subjects  performed  a  data 
collection  training  session  designed  os  a  3  by  3  mixed  factorial  with  display  format 
manipulated  betwen-subjects  and  three  levels  of  a  disturbance  function  manipulated 
wlthln-subjects.  Following  the  two  training  sessions,  each  subject  participated  lt>  64 
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experimental  trials,  each  of  which  was  divided  Into  two  phases;  an  attitude 
maintenance  phase  and  an  attitude  recovery  phase. 

During  the  attitude  maintenance  phase,  subjects  attempted  to  maintain  a 
straight  and  level  display  representation  while  experiencing  a  roll  and  pitch 
disturbance  function,  The  attitude  maintenance  trial  phase  was  a  one-way  design  in 
which  display  format  is  manipulated  between-subjects.  Root  mean  squared  error  In 
degrees  deviation  from  straight  and  level  (RMS)  for  both  pitch  and  roll  was  recorded 
and  analyzed  separately,  A  10  trial  running  RMS  average  or  moving  means  window 
was  also  recorded  for  both  roll  and  pitch. 

The  attitude  recoveiy  phase  was  a  3  by  3  by  6  mixed  factorial  design  formed  by 
the  three  display  formats  crossed  with  three  Initial  pitch  positions  (0,  56  and  -56 
degrees)  and  six  Initial  roll  positions  (0, 60,  120,  180,  -120  and  -60  degrees),  Roll  and 
pitch  were  manipulated  us  wlthln-subjects  variables  while  display  format  remained 
the  sole  between-subjects  variable.  Recovery  accuracy,  decision  time,  and  total 
recovery  time  were  recorded  as  recovery  phase  dependent  measures.  Correct  recovery 
accuracy  was  defined  as  an  Initial  stick  Input  that  resulted  In  display  deflection  In  the 
direction  of  the  shortest  route  toward  the  horizon.  In  the  case  of  an  Initial  roll  and/or 
pitch  position  of  zero,  the  display  must  have  been  deflected  beyond  a  +/-3.7  degree 
dead-band  In  order  to  have  been  registered  as  a  purposeful,  although  Incorrect  Input. 

The  4  /-3,7  degree  dead-hand  was  empirically  determined  to  be  unintentional  noise  In  a 
preliminary  study.  Decision  time  was  defined  as  the  period  between  display 
presentation  Initiation  and  the  first  stick  Input.  Recoveiy  time  was  defined  as  Ihe  total 
time  required  to  recover  from  llie  predclennined  unusual  altitude  to  a  straight  and  level 
status.  Straight  and  level  for  the  present  experiment  mean!  that  subje^  ts  had  recovered 


26 


the  ownship  symbol  to  within  +/-  five  dcftrees  In  both  pitch  and  roll  for  a  duration  of  at 
least  three  seconds. 

Apparatua 

Trial  stimuli  were  presented  on  a  high  resolution  Silicon  Graphics  Iris  3130 
graphics  generator  monitor.  The  monitor  screen  measured  29.5  cm  by  39.5  cm  and 
contained  a  matrix  of  768  by  1024  pixels.  All  Images  were  generated  by  the  Iris  at  an 
update  rate  of  15  H/.,  Trials  were  Initiated  by  the  subject  and  responses  made  on  a 
Measurement  Systems  Inc.  right  hand  two-axis  force  stick  equipped  with  an  Index 
finger  trigger.  Trials  and  trial  phases  were  Initiated  by  the  subject,  by  pressing  the  force 
stick  trigger.  Data  were  recorded  on  the  Iris  at  a  lesolutlorj  of  15H/,.  Data  were 
transferred  to  a  Digital  Corporation  Vax  1 1  /786  to  undergo  reduction  and  analysis. 
Subjects  were  seated  at  a  student  type  desk/chair  that  incorporated  an  attached 
right-arm  half  desktop.  The  force  stick  was  mounted  in  a  hole  cut  in  the  center  of  the 
desktop.  This  chair  configuration  alTorded  the  subject  full  arm  support  while  his  right 
hand  was  on  the  force  stick.  The  front  of  the  desktop  was  clamped  to  the  tabletop  on 
which  Iris  video  monitor  and  keyboard  were  set.  This  clamping  ln»\ired  that  the 
desktop  did  not  shift  during  stick  inputs.  Subjects  were  seated  In  front  of  the  Iris  video 
monitor  so  that  the  display  viewing  distance  was  approximately  4(X!m. 


The  roll  and  pitch  disturbance  function  file  was  devclojjed  so  that  no  apparent 
pattern  was  noticeable  to  the  subject.  The  disturbance  function  was  created  for  a 
previous  siutJy  (Osgood  and  Venturlno,  1990)  and  modified  accordingly  for  use  In  the 
present  study.  The  dlsttirbance  time  history  spectrum  was  gausslan  random  with  a 
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sample  lenglh  of  1024  at  60Hk.  The  spectrum  was  Butttrworth  filtered  with  a  cut  off 
frequency  of  0.6Hz  ( 1  pass-  l2dB  per  octave  rolloff).  The  fllltred  time  hlstoiy  was  then 
fast  fourier  transformed  (forward  full  range),  converted  from  real  and  imaginary  to 
modulus  and  phase,  and  then  converted  to  ASCII  for  the  simulation  to  use  as  the 
disturbance.  Tho  amplitude  cf  the  forcing  function  was  scaled  In  order  to  produce  the 
desired  RMS  values.  Botli  roll  and  pitch  were  driven  by  the  same  basic  function  loop  but 
utlll/,ed  dlfl'eient  starting  points  within  the  loop.  Five  different  starting  points  were 
designated  within  the  17  second  dislurbance  ftincllon.  A  dllTcrcnl  slorllng  point  v,ns 
randomly  selected  (or  each  trial  with  the  stipulation  that  roll  and  pitch  could  not  share 
the  same  starting  point  on  any  particular  trial.  Ttie  disturbance  function  stariing 
points  were  selected  so  that,  at  trial  Initial  Ion,  lOll  and  pilch  dellectlon  was  /.ero 
degrees  (Figure  4).  'fhe  disturbance  was  designed  to  produce  a  constant  predictable  RMS 
In  both  roll  and  pitch  for  each  uf  three  disturbance  amplitude  levels  (low  =  10,  medium 
=  15  and  high «-  20  degrees  mean  display  deflection). 

Placlaya 

A,P(.  'fhe  ADI  format  was  a  computer  generated  simulation  of  an  Inslde-oul 
referenced  electromechanical  ADI  found  in  the  cockpits  of  modern  fighter  aircraft  (Fig, 
1).  The  ADI  was  shaped  like  a  three  dimensional  ball  (23.3  deg)  and  has  roll,  pitch  and 
directional  symbology  printed  on  the  ball  surface.  The  ownshlp  symool  on  the  ADI  was 
the  classic  waterline  schematic  "W  (1.0  by  12.8  deg).  The  waterline  symbol  was  fixed 
with  respect  to  the  Instrument  panel  and  the  display  ball  rotated  about  li  In  roll.  The 
ball  was  free  to  rotate  about  all  three  of  lui  axes.  At  any  one  time,  90  degrees  of  aircraft 
attitude  was  represented  by  thr  display  (+/-46  degree.^  from  the  waterline  symbol)  In  thr 
vertical  component,  and  90  degrees  in  the  horizontal  component  (46  degrees  right  and 
left  of  ownshlp  heading).  Pitch  scaling  was  licked  with  horizontal  pitch  bars  In  10 
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Figure  4.  Disturbance  Function  Amphludc  Ltivcls  nru)  Maintenance  Task  Starling 
F'lints. 
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degree  Increments  from  +/-IO  degrees  to  +/-60  degrees  pitch.  A  roll  and  bank  scale 
along  the  bottom  of  the  display  represented  aircraft  bank  via  ground  pointer  and  scale 
depicting  from  zero  degrees  bank  to  right  or  left  90  degrees,  The  upper  half  of  the  ADI 
ball  was  light  in  shade  (green  on  the  monitor)  depicting  the  sky  and  positive  pitch 
angles.  The  bottom  hemisphere  was  dark  (black  on  the  monitor)  to  reprejicnt  the  earth 
and  negative  pitch  angles.  An  artificial  horizon  line  was  printed  where  the  light  and 
dark  half  of  the  display  contrasted.  The  horizon  line  iuid  vertical  tick  marks  on  It  to 
show  aircraft  heading  in  five  degree  increments. 

Aircraft  attitude  information  was  obtained  from  the  ADI  by  comparing  the 
ownshlp  symbol  location  to  the  ball  orientation.  For  example,  when  the  subject  saw 
the  waterline  symbol  superimposed  over  the  horizon  line  and  the  sky  portion  of  the 
ball  was  positioned  on  the  upside  of  the  ownslilp  symbol,  then  the  display  represented 
straight  and  level  flight.  If  only  the  sky  portion  of  tlie  ball  was  visible,  then  the  display 
represented  an  extreme  noae-high  attitude  or  vertical  flight.  Ukewlse,  a  nose-low 
attitude  was  represented  by  the  dark  half  of  the  ball.  At  extreme  altitudes,  longitudinal 
lines  on  which  the  pitch  ncnle  bars  were  fixed,  appeared  to  converge  and  meet  at  both 
zenith  and  nadir  positions  on  the  ADI  ball.  At  an  atiltude  of  +/  -90  degrees  the  ownship 
symbol  was  superimposed  on  the  point  wticre  these  lines  came  together  and  formed 
what  appeared  to  be  spokes  emanating  from  a  hub.  The  longitudinal  lines  gave  lirading 
information  and  cardinal  headings  were  tagged  with  an  appropriate  (a.6  deg)  lieadlng 
symbol  (i.e.  N,  E,  S.  or  W). 

HUD.  The  I  lUD  formal  was  made  up  of  a  culnilimllon  of  symbology  tlial  Ip 
currently  being  utilized  in  opernllonal  displays  as  well  as  some  symbols  that  liave  l)cen 
rnodlUcd  and  are  Ije'ng  evaluated  lor  use  In  future  cockpits  (Rel.sing,  Zonyuh.  and 
Bartlie’imy,  198fi). 


30 


The  pitch-ladder  HUD  (Fig,  2)  Included  a  bold  centralized  horizon  line  and  near 
parallel  articulated  lines  (one  half  the  angle  of  Incidence)  depicting  pitch  angle  in  five 
degree  increments  up  to  +90  degrees  (zenith)  and  -90  degrees  (nadir).  The  ladder 
subtended  6.3  by  15  degrees  of  visual  angle.  Pitch  line  bars  formed  the  rungs  of  the 
ladder  and,  relative  to  a  fixed  ownshlp  symbol  (2.5  deg),  appeared  to  move  down  as  the 
aircraft  Increased  pitch  and  up  as  the  aircraft  decreased  pitch.  The  aircraft  symbol 
seemed  to  climb  the  pitch  ladder  as  an  Increase  in  aircraft  pitch  continued  and  vise 
versa  for  a  pitch  decrease.  Positive  and  negative  pitch  angles  were  distinguished  by 
continuous  or  broken  pitch-bar  lines.  The  broken  pitch  lines  designated  a  negative 
pitch  angle  while  the  continuous  lines  are  necessaiy  above  the  horizon  line  to  maintain 
a  high  level  of  contrast  against  the  sky. 

Pitch-bar  tags  were  also  included  Into  the  format  and  were  oriented  toward  the 
horizon  at  the  Inner  pitch  line  extremities  on  both  positive  and  negative  pitch  lines. 
Further  roll  Information  was  available  from  a  wide  angle  bank  scale  and  Its  associated 
ground-polnter(41  deg)  located  along  the  bottom  of  the  symbology  set.  Aircraft  heading 
appeared  ao  tape  scale  along  the  top  of  the  format.  Aircraft  heading  was  whatever 
digital  value  appeared  closest  to  the  center  of  the  heading  scale. 

The  HUD  ownshlp  symbol  Included  a  single  vertical  stabilizer  and  a 
conventional  pair  of  horizontal  stabilizers  which  Indicated  the  respective  axes.  The 
observer  was  oriented  In  relation  to  the  display  so  he  was  looking  straight  down  the 
aircraft's  longitudinal  axis.  The  aircraft  symbol  was  fixed  In  the  center  of  the 
symbology  while,  during  maneuvering,  the  pitch  ladder  moved  about  It.  This  formed  a 
pure  aircraft  coordinate  referenced  or  Inslde-out  display/motion  relationship 
(Johnson  and  Roscoe,  1972). 
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THETA.  The  THETA  design  was  a  comblnallon  of  ADI  and  HUD  symbology  and 
structure.  The  THETTA  display  was  a  computer  generated  virtual  three-dimensional 
half  ball  with  symbology  printed  on  the  Inside  as  well  as  the  outside  of  the  ball  (Fig.  3), 
The  overall  display  subtended  22.6  degrees  visual  angle.  The  half  ball  was  oriented  so 
that  an  observer  viewed  the  concave  portion  or  Inner  ball  as  if  the  ball  was  cut  open  at 
Just  less  than  half  (the  clipping  plane  Is  located  at  +/-85  degrees).  Hu-  outside  surface  of 
the  ball  was  shaded  while  the  Inside  of  the  ball  was  transparent.  As  the  ball  rotated,  the 
clipping  plane  remained  fixed  so  that  the  subject  continued  to  look  directly  Into  the 
ball.  Like  the  ADI,  the  THEJTA  format  Incorporated  longitudinal  lines  to  represent 
heading  and  a  single  highlighted  (twice  as  thick  as  the  other  lines)  artificial  horizon 
line,  A  vertical  heading  line  appeared  every  30  degrees  of  azimuth.  Cardinal  headings 
were  labeled  wlUi  a  (1 ,9  deg)  heading  symbol  (l,e.  N,  E,  S,  or  W)  centered  +/-65  degrees 
from  the  horizon.  Each  heading  line  was  tagged  with  pitch-bars  at  30  and  60  degrees. 
The  longitudinal  heading  lines  were  continuous  above  the  artificial  horizon  (depicting 
high  pitch  angles)  and  segmented  below  the  horizon  (low  pitch  angles). 

The  THETA  symbology  ownshlp  symbol  was  Identical  to  the  one  used  In  the 
conventional  HUD  with  the  exception  of  elongated  "wings"  (twice  the  length  of  the  wings 
on  the  conventional  ADI  (4.6  deg)).  As  with  the  ADI  and  HUD,  the  THETA  ownshlp 
symbol  was  fixed  with  respect  to  the  aircraft  while  Uie  display  moved  about  it.  The 
THETA  ownshlp  symbol  was  oriented  on  the  Inside  of  a  virtual  ball  so  that  all  three  of 
the  ball's  axes  run  through  It.  As  the  aircraft  maneuvered,  an  observer  compared  the 
position  of  the  ownshlp  symbol  to  the  Inside  of  the  THE'FA  ball  In  order  to  obtain 


attitude  orientation. 


Procedure 


upon  entering  the  research  facility,  subjects  read  and  signed  a  standard  consent 
form.  The  consent  form  included  a  brief  description  of  the  study  procedure.  The 
consent  form  was  written  to  inform  subjects  of  the  risk,  resoonsibility,  and  liability 
involved  in  the  study.  Subjects  were  asked  to  read  and  sign  Ihr  consent  form  before 
participation  in  the  study  was  authorized. 

After  reading  and  signing  the  consent  form,  subjects  were  asked  to  read  a  set  of 
written  instructions  to  familiarize  them  with  their  particular  symbology  set  and  the 
basic  experiment  procedure.  A  dllTerent  Instruction  set  was  used  for  each  of  the  three 
display  formats.  The  three  Instruction  sets  differed  only  In  what  was  minimally 
necessary  between  the  three  format  types.  Subjects  were  permitted  to  ask  questions  at 
any  time  during  the  Instniotlcn  set  and  the  remainder  of  the  practice  and  experimental 
sessions.  The  study  was  divided  into  three  distinct  sessions  of  which  the  first  two  were 
run  on  the  first  day  (Pay  1)  and  the  third  cn  a  return  visit  (Day  2). 

Day  1.  Session  1  of  Day  1  consisted  of  a  "free-fllght"  period  Intended  to 
familiarize  subjects  with  the  Interaction  belv,/een  the  force  stick  aiid  tlie  characteristics 
of  their  particular  symbology  set.  Session  1  was  performed  in  absence  of  any 
disturbance.  When  the  subject  expressed  satisfaction  with  I  he  display  familiarization 
and  all  questions  were  answered.  Session  1  was  complete.  Session  1  If^sled 
approximately  five  minutes.  After  Session  1,  subjects  read  instructions  on  how  to 
think  about  and  complete  a  Modllled  Cooper-Harper  (MCH)  subjective  workload  rating 
(Wlerwllle  and  Casall,  1983). 
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Session  2  of  Day  1  was  comprised  of  an  attitude  maintenance  task  which  was 
Intended  to  train  subjects  to  accurately  Interpret  and  react  to  their  particular  attitude 
display  format.  Subjects  were  instructed  In  the  pre-experiment  Instructions  and  prior 
to  each  trial  on  the  monitor  itself  to  press  the  force  stick  trigger  in  order  to  initiate  each 
trial.  Subjects  were  Instructed  to  view  the  computer  generated  ARl  and  use  the  force 
stick  to  deunpen  any  disturbance  perturbation  and  maintain  as  close  to  straight  and 
level  as  possible.  Each  trial  lasted  for  17  seconds. 

Each  subject  began  vSesslon  ?  by  first  performing  the  maintenance  task  for  the 
low  disturbance  amplitude  followed  by  the  moderate  amplitude  and  finally  the  high 
disturbance  amplitude.  Subjects  were  required  to  obtain  a  10  trial  RMS  average 
(moving  means  window)  of  14  degrees  or  less  In  roll  and  13.6  degrees  or  less  In  pitch 
before  moving  onto  the  next  disturbance  amplitude  and  ultimately  Day  2.  This 
procedure  Insured  that  the  subjects  were  all  trained  to  a  minimum  level  of  performance 
and  guaranteed  that  all  subjects  experienced  at  least  30  maintenance  task  trials  (10  of 
each  dlsturbemce  amplitude).  The  moving  means  performance  criteria  for  Session  2 
were  empirically  derived  from  preliminary  study  data.  Any  subject  who  failed  to  reach 
criterion  within  120  trials  of  a  single  disturbance  amplitude  was  dropped  from  the 
study  and  replaced.  Subjects  were  informed  of  the  criterion  stipulation  and  were  given 
continuous  performance  feedback  Including  trial  RMS  and  the  moving  means  scores. 
The  number  of  trials  to  reach  criterion.  Individual  trial  roll  and  pitch  RMS,  the  moving 
means  windows,  and  MCH  ratings— performed  after  each  of  the  three  disturbance 
levels"were  recorded  as  Session  2  dependent  measures.  Upon  reaching  criterion  for  the 
low,  moderate,  and  high  disturbance  levels  respectively,  subjects  were  dismissed  and 
asked  to  return  for  Day  2  (Session  3)  data  collection. 
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Day  2.  The  Day  2  Session  consisted  of  12  practice  trials  followed  by  64 
experimental  trials.  The  experimental  trials  Included  an  atlllude  maintenance  phase 
followed  by  an  attitude  recovery  phase.  For  the  attitude  maintenance  phase,  subjects 
were  Instructed  to  press  the  force  stick  trigger  In  order  to  Initiate  each  trial.  Similar  to 
Session  2,  subjects  were  Instructed  to  view  the  computer-generated  ARl  and  use  the  force 
stick  to  dampen  any  disturbance  perturbation  and  maintain  as  close  to  straight  and 
level  as  possible,  ^Tter  the  17-3econd  maintenance  phase,  the  attitude  recovery  phase 
started.  Subjects  viewed  a  static  presentation  of  their  ARI  configured  In  one  of  the 
pre-destgnated  roll/pltch  position  combinations.  The  task  was  to  dynamically  return 
the  display  to  straight  and  level  as  quickly  as  possible  In  the  direction  of  the  closest 
horizon.  Subjects  were  Instructed  that  a  successful  recoveiy  requires  tfiat  the  ownshlp 
symbol  remain  within  +/-  five  degrees  in  both  pitch  and  roll  for  a  duration  of  at  least 
three  seconds.  Subjects  were  Informed  of  the  relative  meaning  of  the  performance 
feedback  they  received  at  the  completion  of  each  trial. 

The  12  practice  trials  of  Session  3  were  intended  to  familiarize  subjects  with  the 
experimental  procedure  as  well  as  warm  them  up  for  the  experimental  trials.  The 
practice  trials  were  comprised  of  the  high  disturbance  amplitude  for  the  attitude 
maintenance  phase.  For  each  trial,  subjects  saw  a  "get  ready"  message  and  Instructions 
to  press  the  trigger  on  the  force  stick  to  begin  a  trial,  The  subject  then  performed  the 
attitude  maintenance  task.  After  17  seconds,  the  display  went  blank  denoting  the  end 
of  the  first  trial  phase,  A  message  on  the  monitor  Instructed  subjects  to  press  the  stick 
trigger  to  begin  the  recovery  phase.  At  this  point  the  computer  read  the  force  stick  Input 
to  Insure  that  It  was  In  a  neutral  position  before  the  display  was  presented.  If  the  stick 
was  not  neutral,  subjects  saw  a  "ZERO  FORCE  STICK"  command  on  the  monitor.  Tills 
acted  as  a  reminder  for  sut  ;cts  to  lighten  their  grip  on  the  stick  so  that  the  altitude 
recovery  phase  would  begin  v  th  zero  stick  input.  Subjects  were  not  permitted  to  lake 
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their  hand  ofT  the  force  stick  during;  a  trial.  The  force  stick  had  to  be  within  Its  neutral 
dead-band  for  two  consecutive  seconds  before  the  ARI  was  presented.  The  attitude 
recovery  phase,  for  the  practice  trials,  was  comprised  of  six  unique  recovery  conditions 
formed  by  crossing  two  pitch  positions  (30  and  -30  degrees)  and  three  roll  positions  (45. 
180,  and  -45  degrees)  with  two  replications. 

The  54  experimental  trials  proceeded  In  much  the  same  manner  as  the  practice 
trials  with  the  exception  that  the  trials  were  fonned  by  crossing  three  pitch  positions  (0, 
55  ,  and  -55  degrees)  and  six  roll  positions  (0,  60,  120,  180,  -60 ,  and  -120  degrees)  with 
three  replications.  As  In  the  practice  trials,  subjects  experienced  only  the  high 
disturbance  amplitude  for  the  attitude  maintenance  phase  of  each  trial.  After  the 
experimental  trials,  subjects  were  thoroughly  debriefed  and  released. 

Balancing,  There  were  10  subjects  for  each  display  condition.  Each  subject 
participated  In  one  experimental  session  of  54  trials  formed  by  crossing  (he  three  pilch 
positions  with  the  sbt  roll  positions  (18  trials)  and  three  replications  of  each  unique 
unusual  attitude  condition.  For  the  attitude  maintenance  phase,  each  amplitude  level 
(low,  medium  and  high)  was  repeated  18  times.  The  conditions  were  randomly 
presented  within  three  blocks  of  18  trials  which  contained  equal  proportions  of  each 
unique  condition.  Replications  were  collapsed  and  not  treated  as  an  experimental 
variable. 
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RESULTS 


The  following  includes  three  mail,  sections  which  represent  the  results  of  three 
Individual  experiments.  The  sections  include  the  Training  .Session,  the  Experimental 
Session  and  the  Training  Rerun  Session.  The  Training  Session  represents 
experimental  results  of  30  subjects  that  successfully  met  the  performance  criterion  on 
the  attitude  maintenance  task.  These  subjects  returned  to  the  laboratoty  to  participate 
In  the  Experimental  Session  and  its  associated  ottiludc  maintenance  and  unusual 
attitude  recoveiy  tasks.  Out  of  the  total  of  45  subjects  that  attempted  the  initial 
Training  Session,  16  subjects  failed  to  reach  performance  criterion  and  thus  were  not 
eligible  to  return  for  the  Experimental  Session.  Of  the  15  subjects  who  failed,  14  failed 
to  reach  the  perfonnance  criterion  with  the  HUD  symbology.  The  n  malnlng  subject 
failed  to  reach  criterion  with  the  ADI  format.  Of  the  14  HUD  subjects  who  failed  to  meet 
performance  criterion,  nine  returned  to  the  laboratory  In  order  to  rerun  the  Training 
Session  with  a  different  display  from  that  which  they  originally  participated.  Kour  of 
the  return  subjects  participated  with  the  THEH'A  format  and  the  remaining  five  subjects 
performed  the  rerun  trials  using  the  ADI.  These  results  are  reported  as  the  Training 
Rerun  Session. 

lialnlng-ScaaloD 

Three  variables  were  of  Interest  for  the  subject  Training  Session.  Tliesc 
variables  included  the  number  of  trials  each  subject  recpilred  to  reach  perfonnance 
criterion,  mean  performance  in  terms  of  RMS  error  in  roll  and  pilch,  and  the  MCH 
ratings  that  subjects  assigned  to  the  task  after  completing  each  of  the  three  disturbance 
amplitude  levels.  Each  of  the  variables  were  analyzed  for  statistical  differences 
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between  the  display  formats,  the  disturbance  amplitude  levels,  and  the  associated 
interactions. 


Trials  to  reach  criterion.  A  3  by  3  mixed  factorial  analysis  of  variance  (ANOVA) 
procedure  was  performed  on  the  trials  to  reach  performance  criterion  data  in  order  to 
test  the  effects  of  display  format  and  the  disturbance  amplitude  levels.  A  significant 
main  effect  for  display  formal  was  found  (£  (2.  27)  ■  4.58,  c  «  0.0 193).  Display  format 
accounted  for  8,32%  of  the  variance.  ATukey  HSD  Post  Hoc  comparison  (Tukey,  1977) 
found  significant  differences  between  the  display  formats  such  that  the  THE^FA 
sjnmbology  subjects,  on  average,  took  fewer  trials  (mean  »  17.40  trials)  to  meet  the 
training  performance  criterion  than  HUD  subjects  (mean  =  36,80  trials).  The  mean 
number  of  trials  lor  ADI  subjects  (mean  ■  27.73  trials)  to  meet  performance  criterion 
was  not  significantly  different  from  that  of  either  the  THETA  or  HUD  subjects.  Figure  5 
illustrates  this  effect.  See  Appendix  A  for  the  ANOVA  summary  tables. 

A  significant  main  effect  was  found  for  the  disturbance  amplitude  Independent 
variable  (£  (2,  54)  »  32.82,  jfl  <=  0,0001).  Disturbance  amplitude  accounted  for  3 1 .29%  of 
the  variance.  A  Tukey  HSD  lest  found  that  the  high  disturbance  amplitude  condition 
(mean  =  48.27  trials)  required  significantly  more  trials  than  both  the  medium  and  low 
amplitudes.  Tlie  medium  (mean  =  2 1.83  trials)  and  low  (mean  =  1 1.83  trials)  amplitudes 
did  not  significantly  differ  from  one  another.  This  effect  can  be  seen  in  Figure  6. 

A  significant  interaction  among  display  formats  and  disturbance  amplitude 
was  found  (£  (4,  54)  »  5.32,  p  =  0.001 1).  Tlie  display  fomial  by  dishu'bance  amplitude 
interaction  accounted  for  10. 14%  of  the  variance.  An  analysis  of  simple  effects 
revealed  that  the  only  significant  difference  between  display  format  was  located  at  the 
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Figure  6.  Mean  Number  of  Trials  to  Reach  Criterion  as  a  Function  of  Display 
Format  During  the  Training  Session. 
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high  disturbance  amplitude  level  (E  (2.  27)  »  7.94,  jj  -  0.0019).  Within  the  high 
disturbance  amplitude,  subjects  using  the  THETTA  symbology  (mean  »  25.70  Inals)  took 
significantly  fewer  trials  to  reach  performance  criterion  than  tnose  using  the  HUD 
format  (mean  ■  73.80  trials).  Figure  7  Illustrates  Interaction.  Performance  with  the 
ADI  format  (mean  »45.3  trials)  did  not  significantly  dllTer  from  either  the  THETA  or 
HUD  format  at  the  high  disturbance  level.  See  Appendix  A  for  the  ANOVA  suromary 
tables. 


RMS  error  performance.  A  3  by  3  ANOVA  procedure  was  performed  on  the  per 
trial  roll  and  pilch  RMS  error  data.  The  d.:ita  were  averaged  across  trlt.  s.  T»vo 
statistically  significant  ctlects  were  found  with  roll  RMS  as  a  dependent  meastire.  The  • 
first  was  a  niuJn  elTeci  of  display  format  (E  (2.  27)  3.94,  p  «  0.0314).  ATukey  HSD  test 
found  ihut  pcrlbiwnrice  In  roll  was  significantly  belter  with  the  TH’iTA  syr.ibology 
(mean  *  12  12  deg)  than  with  the  HUD  (mean  »  14,81  dog).  Performance  with  the  ADI 
(meon  1.1.37  deg)  formal  did  not  differ  significantly  from  either  THBI'A  on  the  HUD 
This  elTect  (Figure  8)  accounted  lor  12, 10%  of  the  variance.  The  second  effect  was  that  of 
a  disturbance  amplitude  main  elTecl  (E  (2.  54)  »  27,23,  j2.'=  0,0001).  A  Tukey  HSD  lest 
found  a  significant  difference  between  all  three  of  the  disturbance  amplitude  levels. 

Ix)w  disturbance  amplitude  reaulied  In  thf  lowest  roll  RMS  (mean  =  1 1 .82  ejeg).  t)ie 
medium  disturbance  amplitude  level  resulted  In  the  next  lilghesi  loll  RMS  (mean  .'j 
13.34  deg),  and  the  high  V'ltflmbance  amplitude  level  resulted  In  the  highest  roll  RMS 
(mean  ^  15,35  deg).  The  disturbance  amplitude  efl’ecl  accounted  for  23. 19%  of  the 
variance.  No  Interaction  between  display  fomiat  and  disturbance  amplitude  was 
Indicated.  See  Appendix  A  lor  the  ANOVA  suniiuary  tables. 

As  with  the  roll  RMS  dependent  measure,  (wo  statistically  significant,  effects 
were  found  with  pitch  RMS  as  a  Oepcn.icnt  measure.  The  first  was  a  main  cITei.t  of 
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HUD 


Figure  8. 


DISPLAY  FORMAT 


Mean  Roll  Root  Mean  Squared  Error  as  n  Function  of  Display  Format 
During  the  Training  Session. 


display  rormnt  (£  (2,  27) «»  3.70,  jQ  »  0.0380).  A  Tukey  HSD  teat  found  that  performance  In 
pitch  was  significantly  better  with  the  THETA  symbology  (mean  «»  10.60  deg)  than  with 
the  HUD  (mean  »  12.89  deg).  Performance  with  the  ADI  format  (mean  *  1 1 .56  deg)  did 
not  differ  significantly  from  either  the  THBSTA  or  the  HUD  (Figure  9).  This  effect 
.*i''counted  for  9.37%  of  the  variance.  The  second  effect  was  that  of  a  disturbance 
amplitude  main  elTect  (E  (2.  54)  •  86.86,  p  ■  0.0001).  ATultey  HSD  te.st  Indicated 
significant  differences  stich  that  the  low  disturbance  amplitude  resulted  In  the  lowest 
roll  RMS  (mean  c  9.25  deg),  the  medium  disturbance  amplitude  level  resulled  In  Hie  next 
highest  roll  RMS  (mean  ■  1 1.71  deg),  and  the  high  disturbance  amplitude  level  resulted 
In  the  highest  roll  RMS  (mean  *  14.09  deg).  Tlie  disturbance  amplitude  effect  accounted 
for  41.83%  of  the  variance.  No  Interaction  between  display  format  and  disturbance 
amplitude  was  found.  See  Appendix  A  for  the  ANOVA  summary  tables. 

Modified  Cooper-Hurpcr.  A  3  by  3  mixed  factorial  ANOVA  procedure  was 
performed  on  the  MCH  ratings.  The  MCH  ratings  were  recorded  for  the  maintenance 
task  at  the  end  of  each  of  the  disturbance  amplitude  levels.  A  main  effect  for 
disturbance  amplitude  was  the  only  statistically  significant  difference  indicated  for  the 
MCH  ratings  (E  (2,  54)  =  24.63.  a  ■  .0001).  Tlie  disturbance  amplitude  effect  accounted  for 
23. 16%  of  the  variance.  A  'Pukey  HSD  Post  Hoc  comparison  found  that  each  of  the  three 
amplitudes  were  significantly  different  from  one  another.  Low  amplitude  resulted  In 
the  lowest  mean  MCH  rating  (mean  «  3. 17  MCH).  Medium  amplitude  was  rated  next 
highest  (mean  *  4.30  MCH)  and  logically  the  highest  amplitude  condition  was  rated 
with  the  highest  overall  mean  MCH  score  (mean  »  5.63  MCH).  Figure  10  represents  the 
disturbance  amplitude  eflect. 

The  MCH  ratings  for  display  format  failed  to  reach  statistical  slgnlllcnnce.  as 
did  the  Interaction  between  disturbance  amplitude  and  display  foi  rnat.  The  mean  MCH 
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rating  for  the  THETTA  symbology  was  4.27  while  the  ADI  and  HUD  formats  resulted  in 
mean  ratings  of  3.93  and  4.90  respectively. 

Experimental  Session 

Trials  In  the  Experimental  Session  consisted  of  an  attitude  maintenance  task 
phase  followed  by  an  unusual  attitude  recovery  task  phase.  The  attitude  maintenance 
task  consisted  of  only  the  high  disturbance  amplitude  which  was  Identical  to  that  used 
during  the  Training  Session.  The  effect  of  display  format  on  RMS  error  In  roll  and 
pitch  was  of  Interest  for  the  attitude  maintenance  task.  Decision  time,  recovery  time, 
and  accuracy  were  recorded  for  the  unusual  attitude  recovery  task  phase. 

Maintenance  task  phase.  Two  3-way  ANOVAs  were  performed  on  the 
maintenance  task  data.  The  first  ANOVA  tested  roll  performance  and  the  second  tested 
pitch  performemce.  A  main  effect  of  display  format  In  roll  performance  failed  to  reach 
statistical  significance.  Mean  roll  pciformance  with  the  THETA  format  was  13.04 
degrees  while  roll  performance  with  the  ADI  was  13.71  degrees.  Mean  roll  performance 
with  the  HUD  was  13.41  degrees.  For  pitch  performance,  there  was  a  significant  display 
format  main  effect  (E  (2.  27)  =  5. 15.  .0128).  The  display  format  effect  accounted  for 

30.41%  of  the  variance.  ATukey  HSD  comparison  Indicated  a  significant  perfomiance 
difference  between  the  THETA  and  HUD  formats.  Pitch  performance  with  the  THETA 
format  (mean  «  12.31  deg)  and  the  ADI  format  (mean  =  12.34  deg)  was  significantly 
better  than  performance  with  the  HUD  format  (mean  =»  13.81).  There  was  no  significant 
performance  difference  between  the  THETA  format  and  the  ADI  format.  This  effect  can 
be  seen  In  Figure  11. 
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DISPLAY  FORMAT 


Flfjure  1 1.  Mean  Pitch  Root  Mean  Squared  Error  as  a  Function  of  Display  Format 
During  the  Experimental  Session. 
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Recovery  '  *.>  ;■  afi*  The  rccoveiy  task  phase  was  formed  of  three  Independent 

variables.  Included  were:  display  format,  initial  roll  position  (-120.  -60,  0,  GO,  120,  and 
180  degrees),  and  Initial  pitch  position  (-55,  0,  55  degrees).  A  first  pass  analysis  of 
variance  was  performed  to  determine  If  there  were  any  statistical 
differences  between  positive  and  negative  direction— rlght/left  roll  and  up/down  pitch 
dimensions— for  decision  time  and  recovery  time.  It  was  found  that  no  significant 
differences  existed  between  positive  and  negative  direction  within  a  dimension.  For 
reasons  of  simplification  it  was  decided  to  perform  and  interpret  the  remainder  of  the 
analyses  using  the  absolute  values  of  direction  within  a  dimension.  Positive  and 
negative  direction  data  were  collapsed  and  averaged. 

Four  3  by  2  by  4  ANOVAs  were  performed  on  the  recoveiy  task  data.  The  first 
analysis  tested  the  decision  time  dependent  variable  for  differences  attributable  to 
display  format.  Initial  roll,  Initial  pitch,  and  associated  Interactions.  The  recovery 
time  variable  was  analyzed  similarly  to  decision  lime.  Two  final  ANOVA  procedures 
tested  roll  and  pitch  Initial  Input  accuracy  differences  for  the  display  formats, 

The  decision  time  variable  consisted  of  the  time  between  tlie  static  presentation 
ol  the  dlsplay-ln  It's  unusual  attltude-and  the  first  stick  Input  made  by  the  subject, 

The  analysis  indicated  main  effects  for  both  Initial  roll  (E  (3.  81)  =  76.26,  c_h:  .0001)  and 
Initial  pitch  (£(l,  27)  =  141.74,  fi  *  .0001)  but  not  for  display  format.  Display  format 
resulted  In  the  following  mean  decision  times:  Mean  decision  time  with  the  THETA 
symbology  was  .780  seconds,  use  of  the  ADI  resulted  in  a  mean  decision  time  of  .744 
seconds,  and  use  of  the  HUD  resulted  In  a  mean  decision  time  of  ,825  seconds.  A  Turkey 
HSD  comparison  found  significant  differences  between  the  Initial  roll  means  such  that 
the  zero  degree  roll  level  resulted  In  the  fastest  decision  time.  Decision  time  for  the  60 
degree  roll  level  was  significantly  faster  than  the  120  degree  and  180  degree  levels  but 


49 


was  slgnlHcantly  slower  than  the  xtro  degree  Initial  roll  level.  There  was  no 
statistically  signlHcant  dllTerence  between  the  120  and  ISO  degree  initial  roll  levels. 
Figure  12a  Illustrates  the  cITecls.  For  initial  pitch,  a  Tukey  HSD  comparison  found  that 
the  zero  degree  initial  pitch  level  resulted  in  a  slgniricantly  faster  mean  decision  time 
than  the  55  degree  initial  pitch  level,  initial  roll  and  initial  pitch  accounted  for  23.01% 
and  1 1.74%  of  the  variance  respectively.  Figure  12b  illustrates  the  elTects.  A 
significant  interaction  was  found  between  initial  roll  and  initial  pitch  (E  (3.  81)  = 

1 1 1.58,  p  =  .0001).  'Hie  Interaction  accoutred  for  16  4 1%  of  the  model  variance.  Figure 
13  Illustrates  the  interaction  effect.  An  analysis  of  simple  effects  found  a  significant 
decision  time  difference  for  roll  only  at  the  zero  degree  Initial  pitch  level  (£  (3.  1 16)  > 
69.1 1 ,  p  >  0.0001).  Zero  degrees  roll  resulted  in  the  fastest  decision  time  (mean  -  0.03 
sec)  while  the  60  degree  roll  level  took  significantly  longer  (mean  ■  0.73  sec),  The  60 
degree  initial  roll  level  resulted  In  a  significantly  shorter  decision  time  than  180  degree 
initial  roll  (mean  ■  0.93  sec).  The  120  degree  initial  roll  level  (mean  =  0.87  sec)  did  not 
significantly  differ  from  either  the  60  or  180  degree  levels.  See  Appendix  A  for  the 
ANOVA  summary  tables. 

A  three-way  Interaction  was  found  between  initial  roll.  Initial  pitch,  and 
display  fonnat  (£  (6,  81)  =  4.39.  p  «■  .0007).  The  Interaction  accounted  for  only  1.28%  of 
the  variance.  An  analysis  of  simple  Interactions  for  display  format  by  initial  pitch  at 
each  level  of  initial  roll  Indicated  only  one  significant  two-way  Interaction  within  the 
three-way  Interaction.  The  two-way  Interaction  was  present  among  display  formats 
and  initial  pitch  at  the  zero  degree  initial  roll  level,  No  other  significant  two-way 
interactions  were  found  at  any  of  the  other  initial  roll  levels.  The  effect  at  the  zero 
degree  Initial  roll  level  Is  Illustrated  in  Figure  14.  An  analysis  of  simple  effects  found 
significant  differences  between  the  display  fonnat  decision  tlrtie  means  at  only  the  55 
degree  Initial  pitch  level.  Mean  decision  time  for  the  ’I'HErrA  (mean  =  0.80  seconds)  and 
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Experimental  Session. 


Fljjure  12b.  Mean  Decision  Time  as  a  FuncUon  of  Initial  Pilch  During  the 
Experimental  Session. 
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INITIAL  PITCH 


F'igure  14.  Menn  Derision  Time  as  a  Function  of  Display  Format  and  Initial  Pitch 
at  Zero  Decrees  Initial  Koll. 
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ADI  (mean  >  0  76  seconds)  subjects  was  slf^niflcanlly  faster  than  HUD  subjects'  mean 
decision  time  (mean  «  1.1X3  seconds).  Decision  time  means  with  tlie  T  HETA  svmbolofjy 
and  the  ADI  .  ere  not  significantly  diffe  -nt  from  one  another. 

The  recovery  time  variable  conslsied  of  the  time  between  the  static  presentation 
of  the  display-ln  it's  unusual  attltudc-and  the  point  at  which  the  display  was 
recovered  to  within  +/-  five  degrees  in  both  roll  and  pitch.  The  analysis  indicated 
significant  main  effects  for  both  Initial  roll  (£  (3,  81)  1(X).20,  p  »  .0001)  and  Initial 

pitch  (f,  (1,  27)  ■  170.31.  a  ■  .0001)  but  not  for  display  format.  Dlspleiy  format  resulted  in 
the  following  mean  recovery  tlmest  Mean  recovery  time  the  THEJTA  symbology  was 
3.01  seconds,  the  ADI  resulted  in  a  mean  recovery  time  of  3.68  seconds,  and  the  HUD 
format  resulted  in  a  mean  recovery  time  of  3.60  seconds.  Initial  roll  and  Initial  pitch 
accounted  for  29.61%  and  27.98%  of  the  variance  respectively.  A  Tukey  HSD 
comparison  found  significant  differences  between  the  initial  roll  recovery  time  means 
such  that  the  zero  degree  initial  roll  level  resulted  in  the  fastest  mean  recovery  time. 

The  60  degree  initial  roll  level  resulted  In  a  significantly  faster  recovery  time  than 
cither  the  120  degree  or  180  degree  levels.  There  was  no  statistically  significant 
difference  found  between  the  120  and  180  degree  Inillal  roll  levels.  Figure  I6i? 

Illustrates  the  effect.  For  initial  pitch,  a  Tukey  HSD  comparison  found  that  the  zero 
degree  initial  pitch  level  resulted  in  a  significantly  faster  recovery  time  than  that  oi  She 
56  degree  initial  pitch  level.  Figure  16b  Illustrates  the  effects  A  significant  interaction 
was  found  between  initial  roll  and  initial  pitch  (E  (3.  81)  »  26.82.  p  »  .0001).  The 
Interaction  accounted  for  only  4.67%  of  the  model  variance  (Figure  16).  An  analysln  of 
simple  effects  found  a  significant  eifect  of  roll  at  the  zero  initial  pitch  level  (£  (3,  1 19)  ■ 

1 18.89,  p  »•  .0001).  It  was  indicated  that  the  zero  degree  Inilial  roll  level  resulted  in  the 
quickest  rccovciy  time  (mean  »  0. 14  sec).  The  60  degree  Initial  roll  level  (mean  =  2.61 
sec)  resulted  in  u  slower  recovery  lime  than  the  Zero  degree  level  li\at  a  faster  recovery 
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Figure  IBa. 


INITIAL  ROLL 


Mean  Recovery  Time  as  a  FuncUon  of  Initial  Roll  During  the 
Bxperlmental  Session. 
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miTlAL  PITCH 


F'lgure  IBb.  Mean  Recoveiy  Time  as  a  rnncllon  of  Initial  Pllc'ii  During  the 
Experimental  Session, 
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time  than  either  the  120  (mean  =  3.63  sec)  or  180  (mean  =  3.62  sec)  degree  level.  There 
was  no  difference  between  the  120  and  180  degree  Initial  roll  levels.  At  the  55  degree 
Initial  pitch  level  (E  (3,  116)  «  7.71.  0.0001)  the  zero  roll  level  again  resulted  In  the 

fastest  recovery  time  (mean  =  3.46  sec).  The  120  (mean  =  4.81  sec)  and  180  (mean  «  5. 10 
sec)  degree  levels  were  no  different  from  one  another  but  were  botii  slower  than  the  zero 
degree  level.  iTie  60  degree  level  (mean  =  4.28  sec)  recovery  time  was  no  different  than 
the  zero,  120,  or  180  degree  levels. 

Initial  Input  accuracy  in  both  roll  and  pitch  was  recorded  by  determining 
whether  or  not  the  subject's  first  recovery  input  was  In  the  direction  of  the  closest 
horizon  for  the  appropriate  dimension.  These  data  were  converted  to  and  analyzed  as 
correct  response  percentages.  An  ANOVA  determined  that  display  format  failed  to 
reach  statistical  significance  at  the  .05  level  (£  (2,  27)  »  2.85,  =  0.075).  Table  1  lists 

the  mean  accuracy  percentages  for  the  roll  and  pitch  dimensions.  An  ANOVA 
Indicated  that  display  format  did  not  result  In  a  significant  difference  for  accuracy  In 
the  pitch  dlmerrslon.  See  Appendix  A  for  the  ANOVA  summary  tables. 

Training  Rervn  Session 

In  all.  a  total  of  15  subjects  failed  to  reach  the  perfonnance  criterion  within  the 
120  trials  allotted  per  disturbance  amplitude  level.  Of  those  subjects,  14  ran  originally 
with  tlie  HUD  display  format.  Tlie  remaining  subject  used  the  ADI  display  format.  In 
response  to  this  disproportionate  failure  rate,  nine  available  HUD  failure  subjects  were 
returned  to  the  lab  to  perform  a  Training  Rerun  Session.  During  the  Training  Rerun 
Session,  subjects  perfomied  the  original  Training  Session  procedure  with  either  the 
THETA  symbology  or  the  ADI  display  format.  Four  of  the  nine  subjects  were  assigned  to 
participate  In  the  Training  Rerun  Session  with  tfie  THETA  format  and  the  remaining 
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Table  1. 


Percent  Correct  for  initial  Recoveiy  Input. 


PITCH 

AVG. 


THETA  ADI  HUD 


81.30% 

70.93% 

75.19% 

70.74% 

60.37% 

70.00% 

76.02% 

65.65% 

72.60% 

live  used  the  ADI.  The  assignment  of  subjects  to  either  the  THETA  format  rerun  group 
or  the  ADI  rerun  group  was  alternated.  The  purpose  of  the  Training  Rerun  Session  was 
to  determine  If  the  HUD  failure  subjects  were  able  to  meet  the  performance  criterion  via 
one  of  the  remaining  display  formats.  All  of  the  Training  Rerun  Session  subjects  failed 
to  reach  the  performance  criterion  of  the  original  Training  Session  with  the  HUD 
format  before  they  were  rerun  with  either  the  ADI  or  the  THETA  fomiat.  The  training 
rerun  data  were  compared  to  the  data  from  similar  variable  conditions  of  the  original 
Training  Session.  This  Information  Is  presented,  when  appropriate,  within  the 
following  results. 

Two  dependent  measures  were  of  Interest  for  the  HUD  rerun  subjects.  Included 
were;  number  of  trials  to  reach  criterion  and  MCH  ratings. 

Trials  to  reach  criterion.  Three  ANOVA  procedures  were  performed  on  the  trials 
to  reach  performance  criterion  data  In  order  to  test  the  effects  of  display  format  and  the 
disturbance  amplitude  levels  for  the  HUD  rerun  subjects.  Alpha  was  held  at  the  0.05 
level  for  each  of  the  three  compeuisons.  The  first  ANOVA  treated  a  comparison  between 
the  HUD  (data  collected  during  the  original  lYalnlng  Session)  and  THETA  (data 
collected  during  the  Training  Rerun  Session)  display  formats.  The  analysis  was 
performed  as  a  completely  wlthln-subjccts  factorial,  A  significant  main  elTect  for 
display  format  was  found  (''.(1,3)  =  223.9 1 .  p  =>  0.0006).  The  display  format  effect,  shown 
In  Figure  17.  accounted  for  25,87%  of  the  variance.  The  results  Indicated  that  the 
subjects,  when  using  the  THETA  format  (mean  =  16. 17  trials),  required  fewer  trials  to 
reach  the  performance  criterion  than  when  using  the  HUD  format  (mean  =  60.5  trials). 
In  the  original  Training  Session,  THETA  symbology  subjects  met  the  performance 
criterion  in  about  the  same  number  of  trials  as  required  for  the  rerun  subjects  to  meet 
criterion  (mean  =  17.4  trials).  Original  Training  Session  HUD  subjects— those  who  met 
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Figure  17. 


DISPLAY  FORMAT 


Mean  Number  of  Trials  to  Reach  Criterion  as  a  Function  of  Display 
Format  During  the  Training  Rerun  Session. 
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the  performance  criterion-required  an  average  of  36.8  trials  to  meet  criterion.  A  main 
effect  of  disturbance  amplitude  was  also  found  (E  (2,  6)  =  22.66,  p  ■  0.0016).  A  Tukey  HSD 
comparison  found  significant  differences  between  the  disturbance  amplitude  levels 
such  that  the  high  disturbance  amplitude  (mean  =  73.38  trials)  required  significantly 
more  trials  to  reach  criterion  than  either  the  medium  amplitude  (mean  =  29.87  trials) 
or  the  low  amplitude  (mean  =  1 1.75  trials).  The  medium  and  low  amplitudes  did  not 
differ  significantly  from  one  another.  This  main  effect  accounted  for  36.00%  of  the 
variance.  Table  2  presents  the  original  Training  Session  means  so  Hint  they  may  be 
compared  to  the  Training  Rerun  Session  means.  The  analysis  also  found  a  significant 
Interaction  between  display  format  and  disturbance  amplitude  (E  (2,  6)  =  6.03,  p  = 
0.0366).  The  Interaction  (Figure  18)  accounted  for  18. 10%  of  the  variance.  An  analysis 
of  simple  elTects  revealed  that  the  only  difference  between  display  format  was  located  at 
the  high  disturbance  amplitude  level  (E  (1.  6) «  39.85,  p  «  0.0007).  Within  the  high 
disturbance  amplitude,  THETA  subjects  (mean  »  26.76  trials)  took  significantly  fewer 
trials  to  reach  performance  criterion  than  the  HUD  format  (mean  »  120  trials). 

The  second  ANOVA  treated  a  comparison  between  the  HUD  (data  collected  during 
the  original  Training  Session)  and  ADI  (data  collected  during  the  Training  Rerun 
Session)  display  formats.  The  analysis  was  performed  as  a  completely  wlthln-subjects 
factorial.  A  significant  main  effect  for  display  format  was  found  (£(1,4)  =  46.43,  p  = 
0.0024).  The  display  format  effect,  shown  In  Figure  19,  accounted  for  23.00%  of  the 
variance.  The  results  Indicated  that  using  the  ADI  (mean  =  20.93  trials)  required 
significantly  fewer  trials  to  reach  performance  criterion  than  when  using  the  HUD 
format  (mean  =  64.47  trials).  As  with  the  THETA  format.  ADI  subjects  In  the  original 
Training  Session  met  the  performance  criterion  In  about  the  same  number  of  trials  as 
the  Training  Rerun  subjects  (mean  =  27.73  trials).  Again,  original  Training  Session 
HUD  subjects  who  met  the  performance  criterion  were  able  to  do  so,  on  average.  In  36.8 
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Table  2. 


Comparison  of  Training  Session  and  Training  Rerun  Session  Mean  Number  of  Trials  lo 

Reach  Criterion. 


THETA 

HUD 

Mean 

ADI 

HUD 

Mean 

ADI 

THETA 

Mean 


SUBJECTS  WHO  COMPLETED 
THE  ORIGINAL  TRAINING 
SESSION 
Amplitude 

Low  Med  High 


SUBJECTS  WHO  RETURNED 
FOR  THE  TRAINING  RERUN 
SESSION 
Amplitu  de 

Low  Mad  High 


Note:  The  mean  number  of  trials  to  reach  criterion  for  the  HUD  format,  which  appears 
on  the  Training  Rerun  section  of  Tabic  2,  represents  those  subjects  who  failed  to 
reach  criterion  performance  during  the  original  Training  Session.  These 
subjects  were  returned  to  the  laboratory  In  order  to  participate  In  the  Training 
Rerun  Session  with  either  the  THETA  or  ADI  format. 
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Figure  18.  Mean  Number  of  Trials  to  Reach  Criterion  as  a  Function  of  Display 
Format  During  the  Training  Rerun  Session. 
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Figure  19.  Mean  Number  of  Trials  to  Reach  Criterion  us  a  Function  of  Display 
Format  During  the  Training  Rerun  Session. 
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trials.  A  main  efTect  of  disturbance  amplitude  was  also  round  (£  (2,  8)  >  18,48,  jj » 
0.0010).  ATukey  HSD  comparison  found  significant  dilTerences  between  the 
disturbance  amplitude  levels  such  that  the  high  disturbance  amplitude  (mean  ns  76.20 
trials)  required  significantly  more  trials  to  reach  criterion  than  either  the  medium 
amplitude  (mean  •  39,80  trials)  or  the  low  amplitude  (mean  12. 10  trials).  The  medium 
and  low  amplitudes  did  not  differ  significantly  from  one  another.  This  main  effect 
accounted  for  33,44%  of  the  variance.  Table  2  presents  the  original  Training  Session 
means  and  the  Training  Rerun  Session  mean-,  .so  that  they  may  be  compared.  Also 
found  was  a  significant  Interaction  between  display  format  and  disturbance  amplitude 
(E  (2.  8)  ■  7.03.  fi  ■  0.0173).  The  Interaction  (Figure  20)  accounted  for  14.20%  of  the 
variance.  An  analysis  of  simple  effects  revealed  that  the  only  difference  between 
display  format  was  located  at  the  high  disturbance  amplitude  level  (£  ( 1,  8)  >  15.99,  u  ■■ 
0.0040).  Within  the  high  disturbance  amplitude,  ADI  subjects  (mean  «  32.40  trials)  took 
significantly  fewer  trials  to  reach  performance  criterion  than  HUD  format  subjects 
(mean  >  120  trials). 

The  third  ANOVA  treated  a  comparison  between  the  THETA  and  ADI  display 
formats  (data  for  both  formats  were  collected  during  the  Training  Rerun  Session).  The 
analysis  was  performed  as  a  mixed  factorial  with  display  format  manipulated 
betwcen-subjccts  and  disturbance  amplitude  manipulated  wlthln-subjects.  Four 
subjects  were  rerun  with  the  THETTA  display  format  and  five  subjects  were  renin  using 
the  ADI.  No  statistically  significant  elTects  were  Indicated  for  display  format  or 
disturbance  amplitude.  These  findings  are  consistent  with  those  of  the  original 
Training  Session.  Table  2  presents  the  original  Training  Session  means  so  that  they 
may  be  compared  to  the  means  of  the  Training  Rerun  Session, 
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Modified  Copoer-Harper.  Similar  to  the  trials  to  reach  criterion  data,  three 


ANOVA  procedures  were  performed  on  the  MCH  data  In  order  to  ira(  ihe  elTects  of 
display  format  and  the  disturbance  amplitude  levels  for  the  HUD  rerun  subjects.  The 
first  ANOVA  tested  a  comparison  between  the  HUD  (these  data  were  collected  during  the 
original  Training  Session)  and  THETA  formats  (theses  data  were  collected  during  the 
Training  Rerun  Session).  The  analysis  was  performed  as  a  completely  withln-subjects 
factorial.  A  significant  main  effect  for  display  format  was  found  (£  (1 .  3)  «  66.67,  p  » 
0.0038).  This  elTect,  shown  in  Figure  21,  accounted  for  38.35%  of  the  variance.  The 
results  indicated  that  the  THETA  symbology  (mean  ■  2.42  MCH)  was  rated  as  resulting 
in  less  workload  than  the  HUD  format  (means  >■  5.75).  During  the  original  Training 
Session,  the  mean  MCH  ratings  for  the  THETA  format  and  the  HUD  were  not 
significantly  different  from  one  another.  For  comparison.  Subjects  of  the  original 
Training  Session  rated  the  task  with  the  THETA  symbology  as  resulting  in  a.  mean  MCH 
rating  of  4.27.  The  HUD  formal  for  subjects  Included  in  the  original  Training  Session 
resulted  In  a  mean  MCH  rating  of  4,90.  A  main  effect  of  disturbance  amplitude  was  also 
found  (E  (2,  6)  ■  20.77,  p  ■  0.0020).  This  main  effect  accounted  for  34.86%  of  the 
variance.  A  Tukey  HSD  comparison  found  significant  differences  between  the 
disturbance  amplitudes  such  that  the  high  disturbance  amplitude  (mean  =  6. 13  MCH) 
resulted  in  a  significantly  higher  MCH  rating  than  either  the  medium  umpliLuMe  mean 
»  3.88  MCH)  or  the  low  amplitude  (mean  a  2.25  MCH).  The  medium  and  low  amplitudes 
did  not  significantly  differ  from  one  another.  The  analysis  also  indicated  a  significant 
Interaction  among  display  format  and  disturbance  amplitude  (£  (2,  6)  =  6.94,  p  «  0.0276). 
The  Interaction  (Figure  22)  accounted  for  10.98%  of  the  variance.  An  analysis  of  simple 
effects  showed  a  significant  difference  between  the  display  format  manipulation  at 
both  the  low  and  liigli  disturbance  amplitude  levels.  At  the  low  amplitude  the  THETA 
symbology  (mean  =  t  n  MCH)  was  assigned  a  significantly  lower  MCH  rating  than  the 
HUD  (mean  =■  3.0  MCH)  fonnat  (£(1,6)  =  27.00,  p  =  0.0020).  At  the  high  amplitude  the 
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Figure  22.  Mean  MCH  Rating  as  a  Function  of  Disturbance  Amplitude  and  Display 
Fonnat  During  the  Training  Rerun  Session. 
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THETA  format  (mean  ■  3.26  MCH)  was  also  assigned  a  significantly  lower  MCH  rating 
than  the  HUD  (mean  ^  0.0  MCH)  format  (E  (1.  6)  «  83.53,  a  •  .0001).  The  means  suggest 
that  the  Interaction  stems  from  an  effect  size  difference  between  the  low  and  high 
disturbance  amplitude  levels.  The  Iniciaction  becomes  dlsordlnal  when  plotted  with 
display  format  on  the  abscissa.  At  the  THETA  format,  low  disturbance  amplil  udc 
reaulted  In  a  significantly  lower  MCH  rating  than  at  the  high  dislui  bance  amplitude. 
Mean  MCH  rating  for  medium  disturbance  nmpllludc  did  not  differ  significantly  from 
either  the  low  or  high  dlsltirbance  level.  At  the  MUD  rortnnl,  both  the  low  and  medium 
disturbance  amplitude  levels  resulted  In  significantly  lower  mean  MCH  ratings  than 
the  high  disturbance  amplitude  level.  Tlie  low  and  medium  level  MCH  ratings  were  not 
significantly  different  from  one  another.  During  tht  original  Training  Session,  no 
significant  Interaction  among  display  fommt  and  disturbance  amplitude  was  found. 

The  second  ANOVA  compared  the  HUD  (these  data  were  collccled  during  the 
original  Training  Session)  and  ADI  (these  data  were  collected  during  the  Training 
Rerun  Session)  display  formats,  The  analysis  was  performed  as  a  completely 
wlthln-subjects  factorial.  A  significant  main  eflect  for  display  formal  was  found  (E  (1, 
4)  B  105,  a  =  0.0006).  Tilts  efrecl,  shown  In  Figure  23,  accounted  for  24. 10%  of  the 
variance.  The  means  Indicated  that  the  ADI  (mean  «  3, 13  MCH)  was  assigned  n 
significantly  lower  MCH  rating  (han  that  of  the  HUD  format  (mean  a  5.4  MCH).  During 
the  original  Training  Session,  the  mean  MCH  ratings  for  the  ADI  and  the  HUD  were  not 
significantly  different  from  one  another.  For  comparison,  subjects  of  the  original 
Training  Session  rated  the  task  under  the  ADI  as  resulting  In  n  mean  MCH  rating  of 
3.93,  Again,  the  HUD  fomiat  for  subjects  Included  In  the  original  Training  Session 
resulted  In  a  mean  MCH  rating  of  4,90.  A  main  efi'eci  of  disturbance  amplitude  was  also 
found  (E  (2,  8)  B  12.81,  pa  0.0032),  A'lXrkey  USD  comparison  found  significant 
differences  between  the  levels  of  disturbance  amplitude  such  that  the  high  disttirbance 
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MEAN  MCH  RATING 


amplitude  (mean  ■  6.0  MCH)  resulted  In  a  significantly  higher  MCH  rating  than  either 
the  medium  amplitude  (mean  o  3.8  MCH)  or  the  low  amplitude  (meari  =  3.0  MCH).  The 
medium  and  low  amplitudes  did  not  significantly  differ  from  one  another.  This  main 
effect  accounted  for  7. 17%  of  the  variance.  No  Interaction  was  Indicated. 

The  third  ANOVA  tested  a  comparison  between  the  THETTA  and  ADI  display 
formats  for  differences  existing  in  the  MCH  data  (data  for  both  formats  were  collected 
during  the  Training  Rerun  Session).  The  analysis  was  performed  as  a  mixed  factorial 
with  display  format  manipulated  between-subjects  and  disturbance  amplitude 
manipulated  wlthln-subjects.  Four  subjects  were  rerun  with  the  THETfA  display  format 
and  five  subjects  were  rerun  using  the  ADI.  Tlie  only  significant  effect  was  that  of 
disturbance  amplitude  (£  (2, 14)  =  14.67,  a  =  0.0004),  Once  again,  a  Tukey  HSD 
comparison  found  significant  differences  such  that  the  high  disturbance  amplitude 
(mean  »  3.67  MCH)  resulted  in  a  significantly  higher  MCH  rating  than  either  the 
medium  amplitude  (mean  =  2.77  MCH)  or  the  low  amplitude  (mean  =  2,0  MCH),  The 
medium  and  low  amplitudes  did  not  significantly  differ  from  one  another. 
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DISCUSSION 


The  resuUs  of  this  experiment  lend  support  to  the  hypothesis  that  an  attitude 
display  symbology  formed  of  the  Integration  of  ADI  and  HUD  type  symbology  will 
demonstrate  a  performance  benefit  over  a  pure  HUD  format.  That  is,  the  Integrated 
display  would  take  on  successful  attitude  conveyance  characteristics  of  the  ADI  but 
would  continue  to  be  see-through,  Transparency  Is  an  Important  requirement  for  any 
symbology  that  Is  being  considered  for  utilization  In  a  head-up  or  helmet-mounted 
configuration.  In  the  present  study.  theTHElTA  symbology  represented  an  Integration 
of  ADI  and  HUD  type  structures.  The  THETFA  symbology  was  designed  to  be  global,  to 
benefit  from  pictorial  realism,  to  be  a  compressed  format,  and  to  be  perceptually 
Integral.  The  previous  features  are  those  thought  to  be  present  In  the  ADI.  The  THETA 
symbology  was  also  designed  to  be  minimally  cluttered  and  transparent  with  the 
potential  for  further  de-clutterlng  and  increased  transparency.  The  merit  of  the  THEI'A 
format  as  an  attitude  Indicator  was  evaluated  In  this  study,  but  display  transparency 
was  not  empirically  tested. 

Naive  subjects  were  used  In  this  experiment  in  order  to  minimize  any  bias  effect 
which  may  have  resulted  from  experienced  pilots'  famlllarll’'  with  the  HUD  and/or  ADI 
symbologies.  Wide  generalization  of  the  study  findings  to  the  experienced  pilot 
population  Is  not  possible  without  a  replication  which  Includes  a  manipulation  of  pilot 
experience  as  em  Independent  variable. 

The  following  discussion  will  first  address  the  Training  Session  findings 
followed  by  a  discussion  of  the  Experimental  Session  findings.  The  discussion 
concludes  with  suggestions  for  further  research. 


75 


During  the  Training  Se:.Hlon,  subjects  performed  an  attitude  maintenance  task. 
Tfie  task  consisted  of  maintaining  a  display  representation  as  close  to  straight  and 
level  as  possible  while  being  buffeted  by  disturbance  functions  of  varying  severity. 
Subjects  were  required  to  reach  a  specific  level  of  performance  on  three  different 
disturbance  function  amplitudes  (Figure  4)  before  they  were  eligible  to  participate  In  the 
study's  Experimental.  Subjects  moved  through  the  disturbance  levels  In  ascending 
order  of  amplitude  atrd  were  required  to  meet  a  performance  criterion  before  moving 
from  one  amplitude  to  the  next,  and  ultimately  onto  the  Experimental  Session, 

The  Training  Session  data  suggest  a  clear  learning  difference  between  the 
evaluated  symbology  formats.  For  the  metrics  collected,  the  THETA  symbology 
afforded  better  performance  and  quicker  learning  than  the  HUD  format.  Subjects  using 
the  THETA  format  met  the  performance  requirement  with  fewer  trials  than  those  who 
used  the  HUD  format.  Overall  maintenance  task  performance  was  better  with  the 
THETA  symbology  than  with  the  HUD  format.  Both  metrics  Indicated  a  benefit  with 
the  THEHA  format  over  the  HUD  symbology.  No  difference  was  found  between  the  ADI 
and  the  remaining  formats.  Statistically,  subjects'  performance  on  the  ADI  was  the 
same  as  performance  with  both  THETA  and  the  HUD.  Perfonnance  with  the  THETA 
formal  was  statistically  better  than  performance  with  the  HUD.  This  seems  to  support 
the  possibility  that  oome  unique  or  enhanced  feature  of  the  THETA  symbology  resulted 
In  the  significant  performance  benefit  over  the  HUD  format. 

There  are  four  main  differences  between  the  THETA  structure  and  the  ADI. 
Included  Is  the  difference  between  the  ownshlp  symbols,  the  contrast  between  the 
positive  and  negative  pitch  areas,  the  connected  THETA  heading  lines,  and  the 
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Increased  display  compression  of  the  THETA  format.  Display  compression  refers  to  a 
relationship  between  a  display  and  the  real  world  which  the  display  represents. 

Display  compression  will  affect  display  rate-of*motlon,  resolution,  and  field-of>vlew. 
This  relationship  can  be  described  as  some  ratio  between  the  display  and  the  real  world. 
The  HDD  display  compression  ratio  In  the  present  study  was  1:1.  As  the  simulated 
aircraft  nose  traversed  along  the  pitch  dimension,  the  HUD  display  represented  that 
movement  across  the  same  distance  at  the  same  rate  The  ADI  Is  a  compressed  format  In 
which  the  display/world  ratio  was  greater  than  one.  The  ADI  artificial  horizon  did  not 
have  to  move  as  far  as  the  natural  horizon  to  represent  the  same  deflection.  This 
resulted  in  an  apparent  slowing  of  display  rotation  when  compared  to  the  motion  of  the 
HUD.  Display  compression  of  the  THETA  symbology  was  even  greater  than  that  of  the 
ADI,  It  was  most  likely  this  Increased  THETA  display  compression  resulted  In  fast 
training  and  good  performeutice.  The  compression  of  the  THEH'A  symbology  acted  to 
slow  the  apparent  display  movement.  The  slower  THETA  motion  enabled  subjects  to 
quickly  Interpret  and  correct  for  the  added  disturbance  function.  The  movement  of  the 
HUD  symbology  may  have  been  too  fast  for  tJie  subjects  to  keep  up  with.  With  the  HUD, 

It  took  subjects  more  trials  to  learn  how  much  force  to  use  and  how  quickly  to  react  to 
the  disturbance  function.  The  magnitude  of  ADI  display  compression  was  bet  ween  that 
of  the  THEH'A  format  and  the  HUD.  This  may  explain  why  no  dllTerences  were  found 
between  the  ADI  and  the  THETA  format  or  between  the  ADI  and  the  HUD. 

It  Is  interesting  to  note  that  the  lack  of  contrast  between  the  positive  and 
negative  pitch  areas  of  the  THETA  symbology  did  not  seem  to  result  In  an  associated 
performance  cost.  The  contrast  between  the  positive  and  negative  pitch  areas  of  the  ADI 
has  traditionally  been  given  much  credit  for  the  display's  value  as  an  attitude  Indicator 
(Burns  and  Lovering,  1988;  Prevlc,  1989;  Roscoe,  Corl,  and  Jensen,  1981;  Taylor,  1982, 
1984,  1988).  Tlie  results  of  the  present  study  Indicated  that  the  contrast  between  the 
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display  halves  was  not  as  critical  for  the  integrity  of  pictorial  realism  as  previously 
believed.  Also,  tlie  contrast  formed  between  the  sclld  lines  of  posklve  pitch  areo  and 
the  broken  lines  of  negative  pitch  area  in  the  THETA  display  was  sufficiently  realistic. 
That  Is,  the  THKI'A  symbology  successfully-  -or  at  least  to  the  same  degree  as  the  ADI- 
portrayed  an  Intuitive  upper  sky  area  and  an  Intuitive  lower  ground  area.  An 
alternative  Interpretation  Is  that  the  THETTA  fomiMi  subjects  benefited  from  some  other 
characteristic  to  the  extent  that  it  made  up  for  the  performance  cost  associated  with  the 
poor  contrast  of  the  design.  Once  again,  this  characteristic  may  be  the  Increased 
display  compression  of  the  THETA  symbology. 

It  Is  likely  that  the  Effects  of  the  Training  Session  were  underestimated  due  to 
the  experimental  design.  There  were  a  disproportionate  number  of  subjects  who  were 
not  able  to  reach  the  Training  Session  performance  criterion  under  the  HUD  symbology 
condition.  Tlie  data  from  these  subjects  were  not  included  In  the  Ti  alnlng  Session 
analysis.  That  la,  the  Training  Session  analysis  was  based  on  data  collected  from  the 
10  HUD  subjects  who  successfully  met  the  performance  criterion.  Fourteen  other  HUD 
subjects  failed  to  meet  the  performance  criterion  and  their  data  were  not  Included  In  the 
analysis.  If  the  14  unsuccessful  subjects  were  irjcluded  In  the  analysis,  the  HUD 
condition  would  have  required  considerably  more  trial. ^  to  reach  the  performance 
criterion  than  arc  apparent  In  the  data.  It  is  likely  that  the  addition  of  the  14 
unsuccessful  siibjects  would  have  caused  the  HUD  condition  to  demonstrate  poorer 
mean  perfomtance  than  with  only  the  successful  subjects. 

The  findings  of  this  study  are  somewhat  confounded  by  a  subject  selection  bins. 
As  merhloned  earlier,  subjects  who  were  replaced  during  the  original  Training  Sesa.lon 
were  almost  exclusively  fion)  the  HUD  fonnat  condition.  In  fact,  94%  of  the  subjects 
who  failed  to  reach  criterion  were  running  with  the  MUD  format  while  the  success  rate 
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for  the  THETA  symbology  was  100%  .  The  success  rate  with  the  ADI  format  was  91%. 
'Phis  suggests  a  systematic  subject  selection  confound  which  was  present  throughout  the 
experiment.  The  reason  for  the  disproportionate  failure  rate  Is  most  likely  due  to  the 
difficulty  of  the  tusk  using  the  HUD  format.  In  the  most  simple  terms,  the  features  of 
the  HUD  acted  to  form  a  dinicult  task  so  that  only  those  subjects  who  were  most 
motivated  and  most  proficient  at  the  task  were  able  to  reach  the  performance  criterion. 
The  more  easily  utilized  THETA  and  ADI  formats  enabled  subjects  of  all  levels  of 
proficiency  and  motivation  to  meet  the  performance  criterion.  Therefore,  the  subjects 
who  represented  the  THETA  and  ADI  formats  formed  a  random  distribution  while  only 
the  most  proficient  and  motivated  subjects  represented  the  HUD  format.  It  sliould  be 
noted  that  one  ADI  subject  failed  to  reach  the  maintenance  task  performance  criterion. 

The  Training  Rerun  Session  was  performed  In  order  to  determine  If  the  subjects 
who  failed  to  reach  the  performance  criterion  with  the  HUD  fonnat  could  reach 
criterion  under  either  the  IHETA  symbology  or  the  ADI.  Nine  of  the  14  HUD  failure 
subjects  returned  to  the  laboratory  to  run  through  the  Training  Session  with  one  of  the 
remaining  display  formats.  Four  of  the  subjects  were  rerun  with  the  THETA  fonnat  and 
the  remaining  five  subjects  were  rerun  with  the  ADI.  The  results  Indicated  that  these 
subjects  were,  on  avereige,  able  to  reach  criterion  performance  with  both  the  THETA 
format  and  the  ADI  format.  However,  one  Rerun  Session  subject  failed  to  reach 
criterion  under  the  ADI  format.  It  should  be  noted  that  these  data  were  somewhat 
confounded  due  to  orderlng--all  Rerun  Session  subjects  experienced  the  HUD  before 
experiencing  cither  the  THETA  symbclogy  or  the  ADI.  Despite  the  ordertng  confound, 
the  Rerun  Session  results  suggest  that  the  reason  for  subject  failure  In  the  Training 
Session  was  that  the  task  with  the  HUD  format  was  more  difficult  than  with  either  the 
THETA  format  or  the  ADI  format.  The  Influence  of  the  symbology  features  was 
demonstrated  In  that  the  subjects  were  able  to  reach  the  criterion  and.  in  addition,  their 
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mean  performance  with  the  THETA  format  and  the  ADI  was  not  much  different  than 
the  performance  of  subjects  running  with  the  same  displays  in  the  Training  Session 
fTable,  2).  Also,  subjects  failed  almost  exclusively  with  the  HUD  but  easily  met  the 
performance  criterion  with  the  THETTA  and  the  ADI  formats. 

The  findings  within  the  Training  Rerun  Session  parallel  those  of  the  Training 
Session  proper.  Subjects  took  fewer  trials  to  meet  the  performance  criterion  with  the 
THETA  symbology  and  the  ADI  than  with  the  HUD.  This  fact  suggests  that  the  THETA 
format  eind  the  ADI  were  easier  to  learn  than  the  HUD  format.  It  should  be  realised  that 
this  comparison  la  somewhat  unfair  given  the  ordering  confound  of  the  lYalnlng  Rerun 
Session. 

Although  the  objective  findings  for  the  Training  Session  data  are  clear,  subjects 
did  not  make  a  subjective  workload  distinction  between  the  symbology  fu.mats. 
According  to  the  MCH  results,  subjects  felt  that  the  training  task-overall-resulted  In 
unacceptable  mental  workload  and  minor  but  annoying  dllTlcully.  It  Is  understandable 
that  the  average  MCH  rating  was  relatively  high  In  that  the  task  was  designed  to  be 
challenging  In  order  to  assure  that  subjects  did  Indeed  learn  their  respective  display 
symbologies  und  tasks.  The  wlthln-subjects  component  of  the  design  was  sensitive  to 
the  three  disturbance  amplitude  levels  for  both  the  subjective  and  objective  data,  but 
subjects  reported  that  the  Training  Session  task  was  of  similar  workload  regardless  of 
symbology  format. 

The  subjective  workload  ratings  for  the  Rerun  Session  Indicated  that  subjects 
found  the  training  task  to  result  In  less  workload  with  the  THETA  symbology  and  the 
ADI  than  with  the  HUD  fomiat.  Subjects  reported  that  the  task  with  the  THEI'A 
symbology  was  of  em  acceptable  level  of  workload,  easy,  and  desirable.  With  the  ADI, 
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subjects  found  workload  to  be  acceptable,  fair  and  mildly  dilTicult.  Training  Rerun 
subjects  reported  that  the  HUD  format  resulted  In  an  unacceptable  workload  level  as 
well  as  very  objectionable,  but  tolerable  dllTiculty.  The  subjective  workload  ratings 
during  the  Training  Rerun  Session  were  compared  wlthln-subjccts. 

The  discontinuity  between  the  subjective  findings  of  the  Training  Session 
proper  and  the  Training  Rerun  Session  may  be  due  to  one  or  any  combination  of  three 
Inseparable  Inlluences.  These  influences  Include  the  different  experimental  designs, 
the  quantity  of  practice  that  Rerun  Session  subjects  experienced,  and  the  subject 
selection  bias.  First,  the  withln-subjects  design  of  the  Training  Rerun  session  may 
have  been  more  sensitive  to  subjective  workload  differences  than  the  between-subjects 
design  of  the  original  Training  Session  due  to  context  effects.  Qreenwald  (1976), 
explains  that  performance  may  be  affected  by  the  context  In  which  levels  of  a  condition 
were  experienced  or  compared  In  a  wltliln-subjects  design,  The  Training  Rerun  subjects 
were  able  to  rate  the  task  with  either  the  THETA  formal  or  the  ADI  In  the  context  of 
what  they  had  already  experienced  with  the  HUD  format.  Secondly,  Training  Rerun 
Session  subjects  experienced  more  practice  than  their  Training  Session  counterparts. 

It  Is  possible  that  the  Rerun  subjects  perceived  less  workload  while  performing  under 
the  second  display  format  (either  THETA  or  the  ADI)  because  they  became  more 
practiced  and  comfortnble  with  the  lask.  Thirdly,  subject  selection  may  have  affected 
the  subjective  ratings  because  only  ratings  from  those  subjects  who  met  perfomiance 
criterion  during  the  onglnol  Training  Session  were  Included  In  the  data.  If  the  HUD 
subjects  of  the  original  Training  Session  were  Indeed  more  hlglily  motivated  or 
proficient  tlian  some  of  the  subjects  that  represented  the  remulnlpg  symbologies,  It 
would  follow  that  the  workload  rating  of  the  HUD  condition  was  an  undere-stimute  of 
what  Is  representative  of  a  random  sample.  Overall,  the  Training  Session  of  the 
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experiment  Indicated  that  the  THETA  symbology,  formed  of  an  Integration  of  both  ADI 
and  HUD  type  symbology,  was  easier  to  team  ttjan  the  HUD  display  format. 

Exncdnicnlal  Scaalon. 

Only  subjects  who  met  the  performance  criterion  of  the  Training  Session 
returned  to  the  laboratory  to  participate  In  the  Experimental  Session.  The 
Experimental  Session  consisted  of  trials  formed  of  both  a  maintenance  task  and  an 
unusual  attitude  recoveiy  task.  The  findings  of  the  maintenance  task  will  first  be 
discussed  followed  by  those  of  the  unusual  attitude  recovery  task. 

The  findings  of  the  maintenance  task  were  stralghtfoiward.  Subjects  were  able 
to  perform  the  maintenance  task  significantly  better  under  the  THETA  and  ADI 
symbology  stnjctures  than  with  the  HUD.  This  was  true  only  on  the  pitch  dimension 
during  the  maintenance  task.  The  roll  performance  trend  was  In  favor  of  the  THETA 
symbology  and  ADI  but  failed  to  reach  statistical  significance.  Overall  Experimental 
Session  maintenance  task  performance  paralleled  that  found  In  the  Training  Session. 
This  was  taie  despite  the  fact  that  all  the  subjects  of  the  Experimental  Session  were 
trained  to  the  same  level  of  performance  during  the  Training  Session.  This  finding 
suggests  that  post-training  performance  of  the  THETA  and  ADI  subjects  continued  to 
Improve  while  HUD  subjects'  performance  reached  a  plateau  at  a  lower  level.  This 
finding  was  consistent  with  the  hypothesis  that  the  TH12TA  and  ADI  groups  would 
demonstrate  superior  performance  over  that  of  the  HUD  group. 

The  Experimental  Session  recovery  task  method  was  essentially  a  replication  of 
earlier  work  published  by  Kinsley,  Warner,  and  Glelsner  (1985)  and  Guttinan  (1986). 

The  findings  of  the  present  study  did  not  completely  replicate  those  of  the  studies  on 
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which  it  was  based.  Although  the  trends  within  the  data  were  in  the  expected  direction, 
no  significant  dllTcrenccs  between  display  format  were  found  for  any  of  the  recorded 
metrics  except  for  the  three-way  Interaction  between  Initial  roll,  initial  pitch,  and 
display  format  for  the  decision  time  metric.  The  Ihree-way  interaction  indicated  that 
the  THETA  format  and  the  ADI  format  resulted  in  significantly  faster  decision  times 
than  the  HUD  format  at  the  zero  degree  Initial  roll  level  and  the  66  degree  initial  pitch 
level  (Figure.  14).  Kinsley  et  al.  (1985),  found  that  decision  time  for  a  statically 
presented  ADI  was  significantly  faster  than  that  for  two  different  HUD  forma ts, 

Kinsley  et  al.  (1985)  found  no  significant  differences  for  Input  error  between  the  formats 
for  a  static  presentation.  In  a  dynamic  evaluation,  Kinsley  et  al.  (1985)  found  no  main 
uffecl  dlflerenccs  between  displays  for  decision  time  but  a  display  effect  for  recovery 
time  was  revealed,  Once  again,  performance  with  the  ADI  was  better  than  performance 
with  the  HUD  format.  Gultman  (1986),  found  no  significant  differences  between  display 
format  for  decision  time  but  a  display  format  main  effect  was  found  for  recovery  time. 
Tlie  analysis  indicated  that  recovery  time  was  significantly  faster  using  the  ADI 
cort^pared  to  the  HUD. 

There  are  two  possible  explanations  for  the  discrepancy  between  the  findings  of 
the  past  studies  and  the  findings  of  the  present  study.  The  first  explanation  Is  that  the 
differences  found  between  the  displays  in  the  past  studies  could  In  actuality  be  evidence 
of  a  training  effect.  The  present  study  utilized  a  more  stringent  training  procedtjre  than 
either  Kinsley  et  al.  (1986)  or  Guttman  (1986).  Kinsley  el  al.  (1986)  gave  the  static 
presentation  subjects  several  trials  in  order  to  familiarize  them  with  the  experimental 
procedure.  Practice  trials  were  continued  until  subjects  reached  a  performance 
criterion  of  90  percent  correct  responses.  For  die  dynamic  recoveries,  subjects  flew  the 
simulator  urttll  they  reported  being  comfortable  with  the  flight  characteristics  of  the 
aircraft.  Subjects  then  performed  36  practice  recovery  trials  (12  trials  of  three  displays) 
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and  were  required  to  meet  the  90%  correct  response  criterion  before  performing  the 
data  collection  trials.  Guttman  (1086)  gave  each  aviator  a  prefllght  briefing  which 
Included  an  explanation  of  the  flight  controls  to  be  used.  Subjects  were  shown  view 
graphs  depicting  each  display  format  to  be  evaluated.  Subjects  were  then  given  18 
practice  (three  of  each  display)  recoveries  before  data  were  collected.  For  the  present 
study,  subjects  were  required  to  meet  the  Training  Session  perfornmnce  criterion  and 
were  given  12  practice  recoveries  before  the  Experimental  Session  data  were  collected. 

It  Is  possible  that  the  extensive  training  of  the  present  study  negated  an  effect  tliat  may 
have  appeared  without  It.  More  specifically.  It  is  possible  that  the  effects  found  in  the 
past  studies  are  actually  evidence  of  a  training  elTect.  The  case  may  have  been  that  the 
subjects  In  the  past  studies  were  continuing  to  learn  the  various  display  symbology 
structures  while  the  experimental  data  wem  being  collected.  Subjects  In  the  present 
study  learned  their  respective  displays  to  such  an  extent  that  the  maintenance  task 
learning  curves  between  the  format  types  converged.  This  had  to  have  occurred  In  order 
for  the  subjects  to  meet  the  Training  Session  performance  criterion.  The  fact  may  be 
that  subjects  can  be  trained  up  to  a  level  of  performance  where  objective  differences 
between  the  formats  disappear.  If  this  Is  the  case,  differences  between  the  formats 
would  appear  as  tlme-to-traln  or  performance  differences  during  training.  This  may 
have  been  the  case  In  this  study.  Unfortunately,  Experimental  Session  subjective 
workload  ratings  were  not  collected.  This  Information  may  have  Indicated  that, 
although  recovery  task  performance  did  not  differ,  subjects  were  experiencing  different 
levels  of  workload  related  to  each  symbology  type. 

The  second  explanation  for  the  discrepancy  between  the  findings  of  the  past 
studies  and  this  study  revolves  around  the  systematic  subject  selection  confound  that 
surfaced  during  the  Training  Session,  Of  the  15  subjects  that  were  Ineligible  to 
parUclpate  In  the  Experimental  Session,  14  were  In  the  HUD  group  and  one  was  in  the 
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ADI  group.  Out  of  all  the  subjects  who  attempted  to  reach  the  training  performance 
criterion  with  the  HUD  format,  only  42%  performed  well  enough  to  participate  In  the 
Experimental  Session.  It  Is  possible,  if  not  likely,  that  the  Training  Session  criterion 
set  up  a  i^stematlc  selection  of  subjects  who  were  more  motivated  and/or  were  more 
proficient  at  the  task  than  those  subjects  who  failed  to  meet  the  perfom^ance  criterion. 
Only  tile  more  motivated  and  proficient  HUD  subjects  were  then  advanced  to  the 
Experimental  Session.  As  mentioned  In  the  Training  Session  section,  the  THETA  and 
ADI  symbology  structures  enabled  subjects  of  all  proficiency  and  motivational  levels  to 
advance  to  the  Experimental  Session.  Because  the  HUD  group  data  are  based  on  the 
most  proficient  and  motivated  subjeclu'  perfoimance,  format  effects  were 
underestimated.  However,  It  should  be  kept  In  mind  that  the  data  trends  were  in  the 
hypothesized  direction. 

The  present  study  demonstrated  that  the  THEI'A  symbology  was  significantly 
easier  to  learn  and  afforded  superior  performance  over  that  of  the  HUD  format  for  an 
attitude  maintenance  task.  From  this  study  it  can  be  confidently  concluded  that  the 
Integrated  THETA  symbology  structure  did  not  produce  a  performance  cost  beyond  that 
which  Is  currently  present  In  either  the  ADI  or  HUD  format  for  the  aid  of  unusual 
attitude  recoveiy.  Because  of  the  subject  selection  In  the  present  study,  no  statement 
can  be  made  as  to  the  performance  benefit  of  the  THETA  symbology  In  lemis  of  aiding 
unusual  attitude  recovery.  Further  research  is  warranted  to  address  the  experimental 
design  Issues  that  have  surfaced  In  this  study  as  well  as  to  continue  development  of  the 
integrated  symbology  concept  into  a  viable  flight  Instrument. 
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Follow-on  studies  will  be  designed  so  that  they  work  toward  eliminating  the 
systematic  subject  selection  confound  that  has  surfaced  In  this  study.  Two  possibilities 
for  accomplishing  this  are:  First,  a  Training  Session  similar  to  this  study  should  be 
utilized  but  subjects  should  not  be  deleted  from  one  display  condition  without  replacing 
an  equal  number  of  low  scoring  subjects  with  "high  proficiency"  subjects  for  the  other 
format  conditions.  Also,  the  training  performance  criterion  cotdd  be  delved  by  pilot 
testing  subjects  on  only  the  HUD  format.  Tills  would  help  determine  the  criterion  so 
that  all  subjects  are  able  to  reach  the  required  level  of  performance.  The  findings  of  the 
present  study  Indicate  that  this  strategy  Is  viable.  It  Is  unlikely  that  a  criterion  level 
derived  from  the  HUD  would  be  too  difficult  for  the  subjects  of  the  remaining  formats. 
The  second  method  Is  to  record  some  Index  of  Individual  subject's  motor  ability.  A 
tracking  task  could  be  perfonned  to  gain  this  data,  Subjects  could  then  be  grouped  and 
replaced  according  to  skill  level.  Inter  subject  variability  could  be  controlled  further 
through  an  analysis  of  covariance.  Also,  If  subjects  failed  to  reach  criterion 
performance,  some  Insight  Into  the  cause  could  be  gained.  The  motor  skill  Index  data 
could  be  utilized  ns  an  experimental  co-varlatc  In  subsequetit  analyses, 

This  study  has  demonstrated  the  potential  value  of  a  THtTl'A  type  Integration  ns 
an  aircraft  attitude  display,  Follow-on  research  elTurts  should  concentinte  on  refining 
the  1'HET'A  format  for  the  flight  environment.  The  study  should  Include  the  evaluation 
of  reduced  FOV  THE'PA  formals.  hr  other  words,  the  display  size  In  terms  of  vistral  angle 
should  be  held  constant  and  THETA  symbologies  of  various  flclds-of-vlew  could  be 
tested.  As  the  display  Is  expanded  the  operator  Is  presented  with  a  jrarllal  view  or  a 
reduced  symbology  flelcl-of-vle\v.  This  In  ulTcct  will  act  to  dccrcusc  display  clutter  and 
cornpre.sston  proportionally.  The  evaluation  should  cletennlne  the  point-percent  of 
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display  fleld-of-vlew— at  which  a  performance  decrement  arises.  THETTA  format 
transparency  should  also  be  empirically  evaluated  alonf{  with  HUD  type  symbology. 

In  the  Interest  of  future  attitude  Indicator  research,  it  Is  the  author’s  suggestion 
that  the  symbology  structure  of  the  ADI  be  studied  at  the  elemental  level.  It  Is 
Important  that  we  systematically  investigate  the  ADI  structure  at  the  feature  level. 

This  research  should  be  accomplished  similar  to  the  method  utilized  by  Taylor  (1988) 
for  HUD  symbology  varlalions.  It  Is  Important  that  we  determine  the  critical  ADI 
symbology  features  that  affect  attitude  awareness  and  attitude  Information 
conveyance.  By  learning  the  eccentricities  of  the  displays  we  can  better  develop  the 
optimal  integration  of  display  features  and  thereby  develop  an  attitude  indicator  that  Is 
highly  useful  and  affords  natural  and  Intuitive  Information,  The  optimized  symbology 
will  deliver  maximum  performance  benefit  while  perceptual  cost  Is  minimized. 
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ANQVA  Summary  lablea 


TRAINING  SESSION 

ANOVA  Summary  Table  for  Trials  to  Reach  Criterion 


Source 

df 

SS 

MS 

E 

Display 

2 

5653.42 

2826.71 

4.58 

0.0193 

SubJect(Dlsplay) 

27 

16650.53 

616.69 

Amplitude 

2 

21261.09 

10630.64 

32.82 

0,0001 

Amp*Sub(Disp) 

54 

17490.47 

323.90 

Di8p*Amp 

4 

6891.78 

1722.94 

5.32 

0.0001 

Amp*Sub(Dlsp) 

54 

17490.47 

323.90 
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'mAININQ  SESSION 


ANOVA  Summaiy  Table  lor  Roll  RMS  Error 


Source 

df 

SS 

MS 

E 

Display 

2 

108.89 

54.44 

3.94 

0.0314 

SubJect(OlspIay) 

27 

372.79 

13.80 

Amplitude 

2 

208.72 

104.36 

27.23 

0.0001 

Amp*Sub(Dl8p) 

64 

206.98 

3.83 

Di8p*Amp 

4 

2.75 

0.69 

0.18 

0.9482 

Amp*Sub(Dl8p) 

54 

206.98 

3.83 

ANOVA  Summary  Table  for  Pilch  RMS  Error 


Source 

df 

SS 

MS 

E 

u.- 

Display 

2 

78.69 

39.29 

3.70 

0.0380 

SubJecKDisplay) 

27 

286.82 

10.62 

Amplitude 

2 

350.82 

175.41 

86.86 

0.0001 

Arnp*Sub(Dlsp) 

54 

109.05 

2.02 

Dlsp*Amp 

4 

13.37 

3.34 

1.66 

0.1738 

Amp*Sub(Dlsp) 

54 

109.06 

2.02 
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TRAINING  SESSION 


ANOVA  Summary  Table  MCH  Raiing 


Source 

df 

SS 

MS 

£ 

a.- 

Display 

2 

14.47 

7.23 

1.06 

0.3608 

SubJecUDlspIay] 

27 

184.43 

6.83 

Amplitude 

2 

91.47 

45.73 

24.53 

0.0001 

Amp*Sub(Dl8p) 

54 

206.98 

3.83 

Dl8p*Amp 

4 

3.87 

0.97 

0.52 

0.7224 

Amp*Sub(Dl8p) 

64 

100.67 

1.86 
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EXPERIMENTAL  SESSION 


ANOVA  Suminaiy  Table  for  Roll  RMS  Error 


Source 

df 

SS 

MS 

E 

tt.- 

Display 

2 

17.89 

8.94 

1.30 

0.2882 

SubJect(Dlsplay) 

27 

185.30 

6.86 

ANOVA  Summary  Table  for  Pitch  RMS  Error 


Source 

df 

SS 

MS 

E 

C." 

Display 

2 

1 16.93 

68,46 

6.16 

0.0128 

SubJecUDlsplay) 

27 

306.61 

11.36 
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EXPERIMENTAL  SESSION 


ANOVA  Summary  Table  for  Decision  Time 


Source 

df 

SS 

MS 

E 

Display 

2 

0.26 

0.13 

0.27 

0.7650 

SubJecKDlsplay] 

27 

12.94 

0.48 

Roll 

3 

9.37 

3.12 

76.26 

0.0001 

Roll*Sub(Dl8p) 

81 

3.32 

0.04 

Pitch 

1 

4.78 

4.78 

141.74 

0.0001 

Pitch*Sub(Dl8p) 

27 

0.91 

0.03 

Roll’Pltch 

3 

6.68 

2.23 

111.58 

0.0001 

Rol*Plt*Sub(Dl8p) 

81 

1.61 

0.02 

RolPDlaplay 

6 

0.32 

0.05 

1.28 

0.2742 

Roll*Sub(Dl8p) 

81 

3.32 

0.04 

Pltch*Dlsplay 

2 

0.004 

0.002 

0,05 

0.9476 

Pitch*Sub(DlBp) 

27 

0.01 

0.03 

Roll*PUch*Dlsp 

6 

0.53 

0.09 

4.39 

0.0007 

Rol*Plt*Sub(Dl8p) 

81 

1.62 

0.02 
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EXPERIMENTAL  SESSION 


ANOVA  Summaiy  Table  for  Recovery  Time 


Source 

df 

SS 

MS 

£ 

IL= 

Display 

2 

21.14 

10.57 

2.15 

0.1364 

SubJcct(Dlsplay) 

27 

12.94 

0.48 

Roll 

3 

244.08 

81.36 

100.20 

0.0001 

Roll*Sub(Disp) 

81 

66.77 

0.81 

Pitch 

1 

230.68 

230.68 

170.31 

0.0001 

Pltch*Sub(Dlsp) 

27 

0,91 

0.03 

Roll’PlLch 

3 

38.78 

12.83 

26.82 

0.0001 

Rol*Pit*Sub(Dl8p) 

81 

38.74 

0.48 

Roll'Display 

6 

4.24 

0.71 

0.87 

0.6204 

Roll*Sub(Dl8p) 

81 

3.32 

0.04 

Pitch*DiBplay 

2 

7.66 

3.78 

2.79 

0.0791 

Pltch*Sub(Dl8p) 

27 

0.91 

0.03 

Roll*Pltch*Dl8p 

6 

4.22 

0.70 

1.47 

0.1992 

Rol*Plt*Sub(Dlsp) 

81 

38.74  • 

0.48 
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EXPERIMENTAL  SESSION 


ANOVA  Summary  Table  for  Roll  Accuracy 


Source 

df 

SS 

MS 

L 

IL= 

Display 

2 

0.05 

0,03 

2.85 

0.0755 

SubJect(Display) 

27 

0.26 

0.01 

ANOVA  Summary  Table  for  Pitch  Accuracy 


Source 

df 

SS 

MS 

E 

fi.® 

Display 

2 

0.07 

0.03 

2.28 

0.1200 

SubJecUDlsplay) 

27 

0.40 

0.01 
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